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Annotation. 

Dynamic  programming  -  smicgent  and  intensely  developing 

section  of  mathematics,  whiuu  giV«s  »  at  nods  fcr  ths  solution  of 
important  practical  problems.  Discussion  deals  with  planning/gliding 
of  production  or  other  processes  wnen  control  by  then  is  realized  by 
a  multistage  path  in  vie*  or  complexity.  To  such  tasks  can  be 

attriouted,  for  example,  tne  selection  of  the  nest  advantageous 
profile/airfoil  for  layang  out  ta»  railway  line  (decomposed  into  the 
secias/rov  of  sections) ,  tne  sea«ction  or  the  best  sizes/dimensions 
of  tha  steps/stages  cf  lultijtugs  rookat  and  many  others. 

In  this  bock  for  the  11. at  usa  in  tne  soviet  litarature  is  done 
the  attempt  to  accessibly  ^r«s*nt  nasic  ideas  and  methods  of  dynamic 
programming. 

The  hook  is  of  interest  rot  »na  vxde  circle  of  the  workers  of 
science  and  production,  anu  <*i.so  tor  all  persons,  developers  of 
conte apor ary  science  interesting. 


Page  J 
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Preface. 

In  the  booh  is  given  cne  exeoentacy  presentation  of  the  Method 
of  dyaaaic  programming  vhicu  is  considjred  as  the  general  nethod  of 
the  construction  of  optimum  scstiwx  ay  different  types  of  physical 
systems.  The  booh  is  intenaes  xox  chi  angineers,  the  economists  and 
the  scientific  vcrhers  cf  u«  j^xxeraac  specialties,  which  are 
occupied  by  questions  cl  planning/ gliding,  and  also  by  the  selection 
of  the  rational  paraaetecs  o*.  cecaniral  da  vices /equipaent .  The -author 
did  not  place  to  hiaself  oy  *ne  wash  of  giving  strict  and  consecutive 
presentation  of  the  aatheaan^ca^.  aspect  of  nethcd,  and  he  attenpted 
to  iate  him  clear  and  available  lui  the  wide  circle  of  practical 
worhers,  who  do  not  have  sp«*,iaa  «atn statical  f oraaticn/education  and 
interested  aainly  in  the  dxr.cc  u»/i  pplicaticn  of  a  nethod  to  their 
tashs  interesting.  This  target  usweraineu  by  itself  the  style  of  the 
presentation  accepted:  the  ovox  oarely  contains  strict  proofs;  the 
explanation  of  the  principle*  ox  m.taod  is  conducted  with  the  support 
to  the  multiple  practical  ta*xs  aun  cue  examples  of  which  many  are 
led  to  the  concrete/specific;/ accua x  numerical  result.  Tashs  and 
exaaples  are  undertahen  from  tn«  «csc  varied  regions  cf  practice;  in 
the  presentation  are  stresses  gei  acax/coanon/total  features, 
which  aahe  it  possible  to  aeoia*  oy  tneir  siailar  aethods. 


•  .J*.  <*  I.  e*'**,  ***!-• 
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0 

rh e  aathematical  apparei.  us,  usei  in  the  book,  is  siaple  and 
nowhere  it  exceeds  the  limits  or  wte  course  of  advanced  calculus,  set 
forth  in  all  VTUZ  £/|igae ».  twcanical  educational 

institution],  and  for  the  mo»t  p<n.t  it  does  net  require  even  this  and 
is  reduced  to  the  siaple  acikaaBuu  ind  algebraic  operations. 

However,  for  the  conscious  Mastering  of  aaterial  is  required  the 
known  stress/ voltage  of  cnou^ht.  ay  soaawnat  unusual  ones  for  the 
inexperienced  reader  can  sea*  tut  used  with  the  presentation  general 
for  aulas;  however,  the  sense  or  tu»s3  formulas  and  figuring  in  them 
designations  is  in  detail  sxri  dMau  lq  the  text.  Per  the 
understanding  of  two  latter/*  as*.  rongrapns  (§§  15  and  16)  is 
required  the  acquaintance  wjuh  u.  elementary  concepts  cf  the 
probaaility  theory. 

The  disaantled/selectsd  at  tee  nook  specific  probleas  intended 
are  selected  very  siaple  tna*.  tuw  cuaoersone  calculations  would  not 
shield  the  entity  of  metheu.  lu  tactics,  as  a  rule,  it  is  necassary 
to  ba  encountered  with  the  aura  cuaplax  probleas  for  solving  which  it 
is  necessary  to  draw  ccntearurai.|  alsctronic  ccaput ational 
engineering.  Keeping  in  nina  tae  u.ei  for  the  ccaposition  of  uachine 
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algorithms,  the  author  for  ue  eiuugition/extent  of  the  entire  book 
uses  the  standard  logic  circuit  uj.  taa  ccastruction  of  the  process  of 
step  oy  step  optimization  ana  rue  standard  sequence  of  formulas, 
which  facilitates  programming  roi  avrsd  (electronic  digital 

computer  ]. 

Che  author  consciccsly  uOUaaaa  aisself  by  the  examination  only 
cf  tha  discretized  problems  „r  agamic  programming  wita  a  finite 
number  of  steps/pitches  a  ana  lent  aside  the  limiting  cases,  which 
correspond  a— and  tc  the  uu  limited  dacraase  of  the  length  of 
step/ pitch.  However,  the  distinct  mastering  of  the  idea  of  method  on 
the  elementary  tasks  can  suuoUM«..ali/  facilitate  tc  reader,  who 
dasiras  to  obtain  more  intimate  aucvledge,  further  study  of 
ob ject/sub ject  on  the  mere  solid  aaiu ga ment s/manual s. 


Ye.  7anttsel* 
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§  1.  Task  of  dynamic  programming. 

jynamic  pro  gram  nine  (or,  otaoi.wj.3a,  "dynamic  programming")  is 
the  special  mathematical  apparatus,  waach  persits  i iplamention  of 
optimum  planning/gliding  or  «.ne  oortroilfcd  processes.  Under  "those 
controlled"  are  understood  t*e  ptuceases  to  course  of  which  we  can  to 
cne  or  the  other  degree  alxewt. 


4idely-known  close  att«SMtacu,  given  ny  contemporary  science  to 
questions  of  planning/glxdiaa  Xm  axl  regions  of  human  activity.  Most 
general  problem  of  optium  i„ast i  rla  aarng/gliding  is  placed  as 
follows.  v 


i,et  be  assumed  to  tae  r^amation  certain  action  or  the  series 
* 

of  tha  actions  (is  shorter,  "Opecataoa")  ,  which  pursues  the  specific 
target.  It  does  request  itself;  uow  it  is  necessary  to  organize  (to 

‘V 

plan)  operation  so  that  it  tuum  be  most  afficient,  i.a.,  in  the  best 
way  satisfied  t£te  stated  berwra  it  requirements? 

* 

so  that  stated  problem  ub  o^t*au«  planning/gliding  would  gain 
quantitative,  mathematical  character,  it  is  necessary  to  introduce 
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into  the  examination  certain  namac-icil  criterion  w,  by  which  we  will 
characterize  quality,  success,  ei^iciaacy  of  operation. 

/alue  W,  depending  on  tua  cuataicar  of  the  decided  task,  can  be 
chosan  by  different  xetbcas.  For  oiample,  during  planning/gliding  of 
the  activity  of  the  system  oc  lauustcial  enterprise*  as  criterion  W 
can  bj  (according  to  the  c*iwua&t&ncas)  selected  the  total  yearly 
voluaa  of  production  or  tne  uet  revenue;  the  criterion  cf  the 
efficiency  of  the  wcrk  cr  traasro«.t  system  can  ba,  for  example, 
generul/common/total  gccds  r. eiaut  turnover  or  the  mean  cost/value  of 
the  shipment  of  the  ten  cf  roau. 

Page  3. 

The  criterion  of  the  efficiency  or  tie  bombing  raid  can  be,  for 
example,  average/mean  area  cc  tr.  caused  destruction  either  ar 
average  number  of  affected  objects,  or  the  cost/value  of  the  reducing 
works  which  it  is  necessary  to  iu*iiil  opponent. 

generally  the  criteriou  or  mirioiaacy  in  each  specific  case  is 
chosau  on  the  basis  cf  tne  fir^osaiui  directionality  of  operation  and 
task  jf  research  (what  element  or  control  is  optimized  for 

which)  . 
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Task  of  rational  plannix. j/aa*uia g  -  to  select  this  method  of 
organizing  this  systen  cf  o^cau^us  ia  order  to  become  maximum  (or 
the  minimum)  some  criterion  \i.  it  as  tae  criterion  is  undertaken  such 
valua  whose  increase  to  us  u_  t-iotitiaia  (for  example,  income  from 
the  group  of  enterprises),  u<tu  xw  taay  attempt  to  become  maximum. 

If,  0.1  the  contrary,  value  •  it  xo  profitable  to  reduce,  then  it  they 
attempt  to  become  the  tiniuux.  it  is  obvious,  the  task  cf  the 
minimization  of  criterion  fe<u»iij  x»  reduced  tc  the  tasx  of 
maxiaization  (for  example,  a^u  caange  cf  criterion).  Therefore 
subse guen tly  in  the  exaiinaucu  or  taa  tasks  cf  planning/gliding  in 
the  g  aneral/commcn/tctal  Stet«.ina  ■*=  wiii  frequently  speak  simply 
about  the  "maximization"  ci  ^.ntwxiou  4. 

let  us  give  now  quantitati vt>,  matuematical  posing  of  general 
problem  of  optimum  plaEXing/^lxaiag. 

There  is  certain  physical  sjstee  3  whose  state  in  the  course  of 
time  varies.  Process  is  ccntxCii«u,  L.«.,  we  have  the  capability  to  a 
certain  degree  to  affect  its  course,  caoosing  at  its  discretion  the 
another  control  (J.  Hith  tne  pcocos*  is  connected  certain  value  (or 
criterion)  w,  which  depends  oa  t*«  used  control.  It  is  necessary  to 
select  this  control  u  sc  tna*  to*  value  k  would  become  maximum. 


Contemporary  mathematical  aua:d  aas  available  the  whole 
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arsenal  of  the  methods,  vhicu  i<iae  it  possible  to  solve  the  task  of 
optiaam  control.  Among  theu  special  position  occupies  the  method  of 
dynamic  programming.  The  spec ii^c  character  of  this-  method-  in  the 
fact  chat  for  finding  the  o^tiaum  control  the  planced/glida  operation 
is  divided  into  the  series/iwe  o..  consecutive  "steps/pitches"  or 
"stag  as”.  Respectively  tae  v*r>  fiocass  or  planning /gliding  becomes 
"multistage"  and  is  deveioptu  couaecitively/serially,  from  one  stage 
to  the  next,  moreover  caca  t*.ao  optimized  control  cnly  at  cne 
step/pitch. 

Page  7. 

Some  operations  natura^y  iaxi  into  the  stages;  in  others  this 
articulation  is  necessary  to  oa^u-ia  artificially. 

iet  us  consider  an  example  "logically  multistage”  operation.  Let 
be  planned/glided  the  active*. y  or  certain  system  of  the  industrial 
enterprises 

n,.  rij* ...»  n, 

for  certain  period  of  time  1,  ea^cu  consists  cf  a  of  economic  years 
(Fig.  1.1). 

In  the  beginning  cf  pei^ou  T  ior  cat  development  of  the  system 
of  enterprises  are  selccteu  -cae  oasic  means  K ;  furthermore,  the 
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functioning  enterprises  giv«*  aom*  anroas,  which  is  realized  at  the 
end  of  aach  year  in  the  iCiic  ca  ^a^e/clean  gain. 

Xn  the  beginning  cf  <2acu  c*oCal  year  (i.e.  at  moments/torques 

t2 . t, . tm)  is  prcducea  Aixanca.ng  tne  entire  system  of 

enter prises,  moreover  fcr  »acn  ox  xham  .s  selected  some  snare  of  the 
means,  available  at  this  t~i.au,  ax  xae  disposal  of  the  planning/gliding 
organ/control. 

aet  us  designate  tnc  auui,  separated  in  the  beginning  of  the 
i  year  in  the  share  cf  ent«xfc.r.i.*»  ny. 

* 

Is  raised  the  question:  now  ls  necessary  to  distribute  on  the 
enterprises  initial  capitaa  f(  ana  xnsoiaes  entering  so  that  toward  the 
end  of  the  period  cf  plaAnina/gxxau.ng  r  total  incoae  from  the  entire 
systaa  of  enterprises  wculu  b*  maximum? 

fhe  formulated  task  is  xno  tit-irax  task  cf  multistage 
planning/gliding. 

i.at  us  look ,  are  seen  uw/  cau  33  approaches  to  the  solution  of 


this  problem 
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'•  't  fj  ,  'i  t  ,  t.  T 

M  •  •  •  •  1-0  ....  aUUod 

Fig.  i.i. 


Kay:  { 1)  .  y  year. 


Page  3. 


-et  us  assume  that  tn®  uiou^ucua  of  means  on  by  1-th  the 
step/pitch  of  operation  is  Cdti.iu  OJt,  i.e.,  we  selected  the 
specific  control  (/,: 

^  =  K'.  x>* . *<*>).  (I.I) 

Formula  (1.  1)  is  read  as  £oju.owsi  cent :oi  (/,  cn  by  1-th  step/pitch 
lies  in  the  fact  that  t>e  iscuat^u  to  enterprise  P  t  cf  means  to 
enterprise  P2  -  means  ■*<.  ana  so  rwstn. 

Jsing  widely  used  tuiiuOi^j,  control  u,  it  is  possible  to 
visualize  as  vector  in  a  n-  ^rauuatsi  space  whose  components  are 
agual  to  .t*/*,  . x'*». 

<.st  us  consider  entrrs  us  controls  (allocated  resources) 


Uv  U, . U, 


(1.2) 
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at  ■  ateps/pitches  of  cftcaUJu  »  a  of  vectors  in  a  k-  diasnsional 
specs.  The  criterion  cf  efiiwi«**.4  *  or  ailtistage  operation,  as 
which  we  did  selact  total  ,UC4*  u»  i  or  /tart,  does  depend  on  the 
entirs  set  of  centrcls 

W  =  V{L Js  Uj . Umy  (1  11 

Is  raised  the  question:  a»  to  ssiect  control  at  each  step/pitch, 
i.e.,  a3  to  distribute  lean*,  so  wi-ac  cat  value  4  would  take  aasiaua 
valus  ? 

The  posed  by  us  tasiu  u.  t.r«o*fic  wxaaple  problea  easily  can  be 
generalized. 

«.et  be  planned/gliaed  t«.a  or«iacioa,  which  falls  to  a  of 
consecutive  steps/pitet ts  or  st «>••.  la  toe  beginning  of  each  (i-th) 
stags  it  is  necessary  in  a  leaner  to  select  available 

paraaeters 


set  of  which 

foras  control  in  the  i  sta*«. 
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A*  it  is  necessary  to  Mi«a  who  set  of  the  controls 

</»•  t/i . «/- 

so  that  certain  value  W,  aw^wnis  on  it,  would  becoae  the 

aaxiaia: 

\V  =  W(UX.  Ut . Um)  =  max? 

Th  o  aethod  of  dynaaic  ** o^aweia j  aaxes  it  possible  to  produce 
this  optiaua  planning/glia^u.,  by  seep,  optimizing  in  each  stage 

only  one  step/pitch. 

Generally  speaking,  tax*  arriwa:&  to  the  deter aination  cf  the 
optiaia  solution  is  not  tne  »oj.j  tvSsxol*$.  The  tasx  of  planning  the 
■ulti stage  processes  in  thu  r c^ut-A^la  auaits  anetber  solution  - 
direct,  with  which  all  ste^s<  p*tcu»s  ars  joined  intc  cna. 

Actually/really,  let  u*  au»«u&:  criterion  4  as  function  froa 
the  ileaents  of  control  at  *»ca  *t«p/pitca: 

W=mV(x*».  *«*>.  .  •  •;  X^'».  x<».  x<*.  . . .) 

(14) 

This  function  of  many  ai’gua«..t»  «.««,  j«  traced  to  the  aaxiaua,  as 
such,  without  the  necessar/  uiiu^acuu  of  the  ela  sent  a/cells  of 
control  "on  the  steps/patcae.".  «o*.  ch^s  it  is  necessary  to  find  this 
value  part  of  arguaents  x<t»(/»  1.2 — /»!•  2....).  with  which  function 
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(1.4)  reaches  maximum. 


it  would  seen,  by  what  It  is  necessary  tc  use  fcr  the 

detersination  of  naxinua  tub  c.a»^cil  method:  to  differentiate 
function  W  of  all  arguments,  to  a^uace  derivatives  zero  and  to  solve 
the  ojtained  systen  cf  eguat^cua; 


d*r 

dx\" 


jw 

ddj> 


=  0. 


0.^  =  0. 

dx1.*1 


dW 


O.r 


ill 


=  0. 


d\V 

dx'i' 


=  0. 


(1.3) 


.iowever,  this  simplic^t,  *s  illusory. 

first,  whan  steps/ >atcu»s  «uu,  tms  nethcd  becomes  very  bullcy. 
The  task  cf  solving  the  system  or  equations  (1.5)  in  the  simplest 
cases  only  proves  to  be  easily  soivaaia.  As  a  rule,  it  is  very 
complicated,  and  frequertlj  it  is  «asiar  directly"  grcpe"  the  maximum 
of  function  (1.4),  than  to  swlvo  sustain  of  equations  (1.5). 


Fage  10. 

furthermore,  the  methou  muicatad  does  net  completely  guarantee 
the  later Jinaticn  of  the  soiui^on  i  iec  us  recall  that  by  itself 
rotation/access  of  derivative  *nto  zero  uoes  not  ensure  the  eaxiaum 
of  function,  and  is  always  r*qu*i»u  further  checking,  doreovec,  this 
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method  does  act  give  the  to  nnd  taximum,  if  it 

lies/rests  not  inside,  tut  o*.  ta«  wouadaiy  of  the  region  of  the 
possijle  values  of  the  argument*  (for  sxample,  see  Fig.  1.2:  the 
absolute  maximum  of  fucctiu^  *s  r«aea*d  not  at  points  x,#  x2, 

I,,  waere  the  derivative  is  »  iuoj.  *.o  zsco,  but  at  end-point  of  the 
region,  in  which  is  preset  us  inaction)  •  So  that  even  in  those  rare 
cases  when  system  of  eaiat^OuS  41.5)  can  oe  solved,  finding  absolute 
maximum  requires  the  whole  systas  of  caecxings,  the  acre  complicated, 
the  greater  the  arguments  u  tunc«,^on. 

Finally,  it  is  necessary  to  »uppi«meat  that  in  the  series/row  cf 
practical  tasks  functict  d  a«*.a.*...y  cannot  be  differentiated;  for 
example,  when  the  elements  o*.  ccutioi  x\*'  •  •  •:  x211-  *'?■  •••'•  x*}  *»’•  ••• 
are  tie  not  continuously  not  Caoaa*ng,  but  discrete/digltal  values. 

All  these  circumstances  l.uu  uo  tus  fact  that  the 
use/application  of  classical  mocnous  of  analysis  (or  the  calculus  of 
variations)  to  the  solution  or  tn«  majority  of  the  tasks  of 
planning/gliding  proves  to  b«  ^uoiiect.ve;  it  reduces  initially 
statei  problem  cf  findicg  tn«  maximum  to  such  secondary  tasks  which 
prove  to  be  net  simpler  tnau  cn«  initial,  but  often  also  it  is  more 
complicated. 


At  the  same  time  the  suutiu  ot  suen  many  problems  can  be 
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subst intidlly  siaplified,  ri  **  ucvei. the  process  of 
planum  //gliding  step  t j  i.a.,  o/  the  method  cf  dynamic 

prograaaing.  The  idea  ct  o«cho>i  m  tae  fact  that  finding  the  aaxiaun 
of  the  function  of  aany  war  ia  mating  is  substituted  by  the 

repaired  finding  of  the  aaxs.jiuu  ui  function  of  cne  cr  snail  number  of 
var  iule/alternating. 

4hat  in  this  case  are  afpiiud  aatnous,  it  will  be  evidently  frca 
the  fallowing  presentation. 


1 
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§  2.  Principle  of  the  step  <c»r  construction  of  optimum  control. 

Thus,  dynamic  programming  -s  «,tap  oy  step  planning/gliding  of 
the  miltistage  process,  aura-g  •nach  ia  each  stage  is  optiai2ed  only 
one  seep/ pitch. 

At  first  glance  it  can  seem  tuat  formulated  idea  is  sufficiently 
trivial.  Actually/really,  ta&t  tn»  hsra  odd:  if  it  is  difficult  tc 
optimize  control  immediately  fur  tne  eiongaticn/axtent  cf  entire 
operation,  then  to  decompose  it  into  tua  series/row  of  consecutive 
steps/pitches  and  tc  optiaun*  acea./  each  stap/pitch.  Not  so 

uhethar  ? 

Completely  not  thus  !  Ua  principle  of  dynamic  programming  does 
not  in  any  way  assume  that,  cauwsiig  control  at  one  single 
step/pitch,  it  is  possitla  to  ror^st  aoout  all  ethers.  On  the 
contrary,  contrcl  at  each  ste p/^itch  mast  be  chosen  taking  into 
account  all  its  aftereffects  in  im  rat  are.  Cycamic  programming  - 
these  are  planning/gliding  rarsigntad,  talcing  into  account 
nrosoect,  This  not  short-sighted  planning  ’’blindly"  for 
one  sten  ("cone  vrhat  nay  nrovided  was  now  ^ood"),  On  the 
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contnry,  control  at  each  dt-p/^wuh  is  coosen  oa  the  basis  cf  the 
interests  of  operation  as  a 

Get  us  illustrate  the  ^Aacie-ie  of  "farsighted"  planning/gliding 
based  on  examples. 

Get,  for  example,  be  pxa.uuieu/alidjd  the  work  of  the  group  of 
heterogeneous  industrial  ext for  the  period  of  time  a  of 
years  and  final  task  is  ofct«u.nxxig  oha  jauaui  capacity  cf  the 
production  of  certain  clas*  C  of  consumers'  goods. 

In  the  beginning  cf  a  specific  supply  cf  means  of  the 

production  (machines,  equina* as.* ,  miia  one  help  of  which  it  is 
possible  to  begin  the  prcdacuAo**  ox  goods  of  this  class. 

fly  "step/pitch"  or  "s^aja"  oa  to  a  process  of  planning/gliding  is 
fiscal  year.  Let  for  us  be  lx.  on*  selection  of  the  solution 

for  tae  purchase  of  raw  mat&.i<ix,  machxues  and  the  distribution  of 
means  according  to  the  enterc  rxoe*  to  one  first  yaar.  During  the 
"shor&*sighted"  step  by  sur  piauu^ng/gl xdi ng  we  would  make  the 
decision:  to  put  a  maximum  if  means  into  the  purchase  of  raw 

material  and  to  release  exist! macaiuaa  at  full  power,  whereas 
approaching  the  maximum  ca^xc;  oa  cna  production  of  class  C  toward 
the  end  of  the  first  year. 
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To  what  it  can  give  Um  pj.&Muia  g/ gliding?  Io  the  rapid  wear  of 
machine  park  and,  as  a  resaxc,  to  the  race  that  on  the  second  year 
the  production  will  fall. 

During  the  farsighted  pj-auaiu^/giidiag,  cn  the  contrary,  will  be 
proviled  the  actions,  whi.cn  ansui«  filiiag  machine  park  in  proportion 
to  its  wear.  Taking  into  account  suca  ^avastaents  the  capacity  of  the 
production  of  the  basic  gooua  C  in  tna  first  year  will  be  less  than 
it  could  be,  but  will  be  province  the  possibility  of  expanding  the 
production  during  the  stbsegneut  j«acw. 

Get  us  take  another  exaspx*.  aha  process  cf  planning/gliding  in 
the  cneckered  game  also  wu.1  *.ato  tne  single  steps/pitches 

(courses).  Let  us  assume  tna..  tat  rigures  are  conditionally  evaluated 
by  one  or  the  other  number  o.  gaa^ses  wxta  respect  to  their 
importance;  taking  figtre,  *o  w^n  this  number  of  glasses,  and  giving 
up  -  we  play  back. 

ieasonably  whether  it  w^ii,  tniax^ag  over  chess  match  on  several 
steps/pitches  forward,  alwd;.,  <*rt...oar n  at  each  step/pitch  to  win  a 
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maximum  number  of  glasses?  it  ia  onvrous,  no.  This,  for  example, 
solution,  as  "to  endow  rugur*.",  rover  can  be  prcritafcly  from  a  narrow 
point  of  view  of  only  ere  course,  tut  n  can  be  profitably  from  the 
point  of  view  of  natch  as  a  shot*. 

io  is  matter,  alsc,  iu  aQj  region  or  practice.  Planning/gliding 
multistage  operaticn,  we  aus.  cnewsa  control  at  aach  step/pitch,  on 
the  basis  not  of  the  narrow  interests  of  precisely  this  step/pitch, 
but  of  the  wider  interests  o£  ot.ej.atroti  as  a  whole,  and  hardly  ever 
these  two  points  cf  view  coincide. 

Jut  how  to  construct  ta*s  control?  we  already  formulated  the 
general  rule:  in  the  prccass  cr  s*.*.p  ay  step  management  planning  at 
each  stap/pitch  must  be  acce^tou  waiting  rate  account  the  future. 
Howevur,  frem  this  rule  t aer«  an  axception/elimrnaticn.  Amcng  all 

steps/pitches  there  is  cne,  waa.cn  car  oa  planned/glided  simply, 
without  the  "caution  tc  tns  £utur«".  wuat  this  is  step/pitch?  is 
obvious,  the  latter.  This  iai ter/xast  step/pitch,  single  of  all,  can 
be  planned/glided  so  that  re  ao  such  wouxd  yield  tae  greatest  profit. 

after  planning  optimour*  c ar*  lat;er/last  st8p/pitch,  it  is 
possiole  to  it  "to  attach"  a»xt-tw-lasr,  to  this  in  turn,  of 
prepeuultiraate,  etc. 
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Therefore  the  process  o..  programming  Is  always 

turnei/run  up  in  the  opfosit®  ou  cae  time  direction:  net  from  the 
beginning  toward  the  end,  out  uoi  tae  ana/lead  at  the  beginning. 
First  of  all  is  planne d/ gliua u  i«. tec /last  step/pitch,  but  as  it  tc 
plan,  if  we  do  not  knew  hew  ui a  «*ou  ue <t-t o-last?  It  is  obvicus,  it 
is  necessary  to  do  different  assumptions  about  that  hew  ended 
next-co-last  step/pitch,  ana  to*.  «acn  or  them  tc  select  control  on 
the  litter. 

This  optimum  contrci,  s«iacc«a  anoar  tfce  specified  condition 
about  that  how  ended  the  piowious  stap/picch,  we  will  call 
conditional  optimum  ccntxcl. 

The  principle  of  dynamic  p*.o^ raramra g  regeiras  determination  at 
each  step/pitch  of  conditional  opcamum  control  for  any  of  the 
possible  issues  of  the  pxeceuiuy  step. 

Let  us  demonstrate  tam  of  tais  prccadure.  Let  be 

plann ad/glided  a  ra-  step  operatic#,  and  it  is  urknown  hew  ended  (m-1) 
-th  step.  Let  us  do  about  u.s  a  aonas/xow  of  "hypotheses"  cr 
"assumptions".  These  hypotnea as  w>  will  aesignata: 

5',?., . *«/•_,.  •••  (2-U 
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•e  will  be  specified,  that,  uy  latter  is  net  compulsorily 

designated  one  number:  tms  caa  l*>  and  tne  greup  of  the  numbers, 
which  characterize  issue  (ju—  1  j  -u  or  step  but  can  be  and  the  simply 
qualitative  state  of  that  p^sica,.  system,  in  which  proceeds  the 
controlled  process. 

let  us  find  for  each  or  assumptions  (2.1)  conditional  optimum 
control  on  the  lattar/last  (liy  ta«  a-ta)  step/pitch.  This  will  be 
that  of  all  possible  ccrtroi-  U„.  at  wuich  attains  a  maximally 
possible  value  gained  at  tne  iattwi/iast  step/pitch. 

».et  us  assume  that  for  ,ica  w*.  assumptions  (2.  1)  conditional 
optimum  control  (/*„  on  tie  it.ut/iost  step/pitch  ir  found: 

U'm  (5m1-  i>.  U\  (5t?_ U’m  (Sf,t .):  ■  •  ■  <2. 2) 

This  leans  that  the  latter/ xo st  stoep/pitca  is  planned  for  any  issue 
cf  na xt-to-last. 

Page  14. 

i.et  us  switch  over  to  auuiup/g  iiaiug  cf  follcwing  frem  the 
end/Liad,  next-to-last  step/r ito*..  Lot  us  again  do  a  saries/rew  of 
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hypotheses  about  that  hew  eiia  ia  ^•penultimate  ((a- 2)  -th)  the  step: 

c*11  v-’>  ,  •  ,  (2.3) 

Omi-3'  . v>„,_2-  •••  V 

Let  us  raise  the  question;  n^w  .t  is  necessary  to  chocse  for  each  of 
these  hypotheses  conditional  optimum  control  at  (a-1)  -th  the  step? 

It  is  obvious,  it  must  ue  cnosen  so  that  it,  together  with  the 
already  selected  centres  at  w0«  matter/last  step/pitch,  would  ensure 
the  aaximum  value  cf  criterion  ■  at  two  iatter/last  st aps/pitches. 

In  ether  wards,  for  esu  or  aj  potasses  (2.3)  it  is  necessary  to 
find  this  conditional  optimum  couoror  on  (m-1)  -th  step  u’„-,(S,n-2).  so 
that  it,  in  conjunction  witn  due»uy  obtained  conditional  optimum 
control  u’n  (5,«_i).  would  cive  a  maximally  possible  pri2e  at  two 
lattec/last  steps/pitches. 

It  is  obvious,  toward  (m-l^-mu  to  step/pitch  thus  accurately  it 
can  ba  connected  ( m-})  -th  a.d  so  rorta  up  to  the  quite  latter/last 
(frea  the  end/lead)  1st  step/pitem  from  waich  the  process  begins. 

The  first  step/piten,  i*  CLituast  to  all  others,  is 
planned/glided  somewhat  ctne*. wia«.  Since  we  usually  know,  from  what 
begins  the  process,  then  for  ua  n>  no  louder  required  to  make 
hypetneses  about  state  in  wo.cn  •«  bagrn  the  first  step/pitch.  This 
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state  to  us  is  known.  Therutsro,  taking  iato  account  that  all 
subs*  juant  steps/pitches  ix.u»  xnu,  tab  3ra,  etc.)  are  already  planned 
(coniitionally)  ,  tc  us  at  redan.*  samply  to  plan  the  first  step/pitch 
so  that  it  would  be  optimum  tdkin3  iato  account  all  controls,  already 
accepted  in  the  best  way  by  an  aucsa  great  steps/pitches. 

The  principle,  placed  a*  a  as  as  of  the  construction  cf  such 

solution  (to  seek  the  always  o^t-aua  continuation  cf  process  relative 
to  that  state,  which  is  acuvv«uAta:add  at  the  given  mcment)  they 
frequently  call  the  principle  or  ».ae  optimum  character  (see  [1]). 

The  general/ccmmcr/rctd*  e^^afaUJa  of  the  method  of  the 
construction  of  the  cptamum  *ciUi*Qn  by  cne  method  cf  dynamic 
programming  which  was  given  ^,n  u«  peasant  paragraph,  in  view  of 
guita  its  generality  can  sc«m  ncomprenensible.  Therefore  the 
following  paragraphs  (§§  w «  will  laureate  to  the  solution  of  the 

specific  problems  on  which  i«t  u*  cry  io  give  tc  him  more 
intelligible  interpretation.  Sunso^uantly,  into  $  6,  we  again  will 
return  to  the  genera l/ccmaon/  total  formula  tier,  cf  the  problem  which 
will  prove  to  be  clearer  against  «.ue  background  of  the  already 
dismaatled/selacted  specific  examples. 
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§3.  Task  about  the  gain  of  a*txcu ne  aua  velocity. 

Jne  of  the  simplest  caa*s,  suivad  by  the  method  cf  dynamic 
programming,  is  the  task  auout  oa«  optimum  climb  and  velocity  flight 
vehicle.  From  this  task  we  D«»gin  ^resautar icn  of  practical  procedures 
of  dynamic  programming,  mcreuvar  .or  tae  purpose  of  systematic 
clarity  the  conditions  of  t<u.x  1..1  ua  to  the  extreme  simplified. 

Task  consists  of  the  10.10^^.  fae  aircraft  (or  another 
aircraft  ),  which  is  found  o..  a«*.,at  ti0  and  which  has  velocity  V0, 
must  ue  raised  tc  base  altitude  Hxmt,  ana  its  velocity  is  led  to  preset 
valua  I',,,,.  Is  known  the  tuei  wOnjaerti.oa,  reguired  for  lifting  the 
apparatus  from  any  height  n4  ca  any  another  H2>Ht  at  the  constant 
velocity  7;  is  known  also  ta«  iu«.  consumption,  required  for  an 
increase  in  the  velocity  ticn.  au;  vaxae  of  Vj  tc  any  ether  V2>7t  at 
the  constant/invariable  tie.^ut  a. 

It  is  necessary  tc  finu  tae  oyti.ua  climfc  and  velocity  during 
which  general/ccmmon/tctal  tafiu.  cwnsumation  will  be  minimum. 


The  solution  we  will  couSUUbt  as  follows.  For  siaplicity  let  us 
assuai  that  entire  orocsss  ot  ium  *a..a  or  altitude  and  velocity  is 
divided  into  the  series/cow  or  cousecaoive  ste ps/pitchas  (stages), 
and  far  each  step/pitch  dire*,  art  xaccdases  only  height  or  only 
velocity . 

We  will  be  depict  tue  wi  aircraft  with  the  help  of  the 

point  on  certain  plane  VQri,  ■□•*.»  tha  abscissa  represents  the 
velocity  of  aircraft  V,  ana  ^ruruate  -  its  height  H  (Fig.  3.1). 

The  process  of  the  d  is  ^r.  acedia  ut  or  point  S(  which  represents  the 
stata  cf  aircraft,  fro  tne  .arc.nr  stats  S0  into  final  5.,*  will  be 
depicted  on  plane  voh  as  certain  stepped  orclcen  line.  This  line 
(trajactory  of  the  action  cr  ^ora.  S  os  plane  VOH)  will  characterize 
control  of  the  process  ct  tn«  ^a.**  of  altitude  and  velocity. 

Page  16. 

It  is  obvicus,  there  ar«  possible  controls  -  aany 

trajectories  cn  which  it  is  t  osa.u  .e  to  translate  point  S  fro  s0  in 
Stnm.  T t  these  all  trajectories  *t  .s  aecessary  tc  select  that  cn  which 
the  selected  criterion  V  (tu«i  ctwauapticn)  will  be  niniaua. 


In  order  to  construct  tu«  solution  oy  the  Bathed  of  dynaric 
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programming,  let  us  divide  n«.igut  H%am  —  H0,  which  aust  be  assembled  on 
aircraft,  on  nt  of  the  c^uajl  p«it.»  (toe  example,  to  six,  see  Fig. 
3.2),  and  velocity  V.,*  —  Vo*  wuicu  .t  is  necessary  to  gather,  cn  n 2  of 
equal  parts  (for  example,  to  4Xauw>.  aet  us  divide  the  process  of  the 
gain  of  altitude  and  velocity  tae  single  steps/pitches  and  we 

will  consider  that  fer  cne  at jr/f*tca  cae  aircraft  can  either 
increase  height  by  value 


or  velocity  -  to  value 


H„ «,  -  Ha 

"i 


—  ^i) 

"  "> 

A  nuaoer  of  parts  nt,  r2  utw  waicn  are  divided  intervals 

—  —  fundamental  v«m«  uv.es  not  have  and  can  be  selected  on 

the  basis  of  the  requirement*  tu  ths  accuracy  of  the  solution  of 
problem.  Pair  of  numbers  nt,  n2  u«tacaines  by  itself  the  total  number 
of  st eps/pitches  a  of  tie  muiUdCa^e  process  cf  the  gain  of  altitude 
and  velocity 


/ft  =  -f-  rtj. 
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Of  our  case  (Fig.  3.2)  any  trajectory  will  consist  cf  fourteen 
steps/pitches: 

m  =  6+8=rl4 

(as,  for  example,  each  cf  two  ttajectori.es,  noted  by  arrows/p cinters 
in  Fig.  3.2).  Being  moved  rrja  S,  xn  S,„>-  point  £  can  move  only  over 
the  horizontal  and  verticax  *ego«uis. 

-et  us  register  cn  eat  a  or  tans*  segaents  (Fig.  3.3)  the 
corresponding  to  it  fuel  ccit» aa^trcn  xa  some  arbitrary  units  l. 

POOTH JTE  >.  The  digits,  give*.  x*  J.  1,  are  salected  from  the 

systeaatic  consideraticrs  ana  uotaxnj  xn  coaacn  with  the  real  fuel 
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consumption  thay  have.  E  NDr  Do 

Any  trajectory,  whicn  point  S  fron  S0  in  S„,m.  is 

connected  with  the  specific  £  tiex  ccns  urn  aticn.  Per  exaaple,  the 
trajectory,  depicted  as  arro» s/ro*ntac i  in  Pig.  i.i,  gives  the  fuel 
consumption,  equal  tc  «=  1 2*  1 1  *•  1  0*$ *  11  ♦d ♦  10  ♦  10  ♦  1 3«- 15 ♦  20*  9^  1 2*  1 4=  1 63 
(conditional,  units)  . 
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Fig.  1.2. 

Page  18. 

It  is  obvious,  theca  i*  a  vb4. j  l dcge  nueter  of  different 
trajectories,  which  translate  i  ui  S„  in  S.M-  and  to  each  of  thea 
corresponds  its  fuel  cccsua^ccou  |/.  «ie  saculd  of  such  all 
trajectories  find  optiaca  -  that,  on  wnico  the  fuel  ccnsunpticn  is 
■iniaal.  It  would  be  pcssi^i.  u  3oes  without  saying  to  sort  out  all 
possisle  trajectories  ard  in  ta*  c^nal  analysis  to  find  optinua,  but 
this  -  very  bulky  path,  aucu  a  o*.«  wfteu  it  is  possible  to  solve  task 
by  th i  aethod  of  dynaiic  on  toe  steps/pitches. 

Process  consists  cr  a»u  steps/pitches ;  we  will  cptiaize  each 
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step/pitch,  beginning  froa  a  .Lamer.  Tne  final  state  of  aircraft  - 
point  •'>K01(  on  plane  VOH  -  to  *s  *s  ^rasut.  The  fourteenth  step/pitch 
without  fail  oust  lead  us  mio  pome.  Let  us  look,  whence  we  can 

move  into  point  S^M  at  the  iwiucdentn  step/pitch. 

<*et  us  consider  the  se^aia^j  cigar  upper  angle  of  rectangular 
grid  (Pig.  3.4)  with  end  porut  SMr  In  point 

^it  is  possible  to  nove  of 

two  adjacent  points  (8,  ana  H:).  t  aoraover  of  each  -  only  in  one 
wanner,  so  that  the  selection  or  conditional  ccntrcl  at  the 
lattec/last  step/pitch  we  ao  not  nava  any  -  it  is  singular.  If 
next-co-last  step/pitch  lea  us  xuco  point  Bt,  then  we  must  neve  over 
the  horizontal  and  expend  1/  of  z uei ;  if  we  into  point  Bz,  go 

cn  th  *  vertical  line  and  to  14  unity. 
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Fig.  i.  3, 


Pag**  19. 

Lat  ui  register  these  xirimu*  Uu.s  case  simply  unavoidable)  fuel 

consumption  in  the  special  s-tan  circles  which  let  us  supply  at 
point s  8| ,  B2  (Fig.  3.5).  Iu«  icoordiuj  a y  "17"  in  the  small  circle 
in  B|  it  indicates:  "if  we  a^r^vau  in  3 1 ,  then  the  minimum  fuel 
consumption,  which  translate*  a*  xnto  point  S„m.  was  equal  to  17 
unity".  Analogous  sense  has  a  iacuAding  oy  "14"  in  the  small  circle 
at  point  B2.  The  optimum  cca.rJi,  -hica  leads  tc  this 
expen  litura/ccasumpticr ,  is  .<uuu  in  eacn  case  by  the  arc ow/pointer, 
which  emerges  from  the  smaii  c.*.oau.  dunuar/ri f leman  indicates  the 
direction  over  which  we  must  move  true  tms  point,  if  as  a  result  of 
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cur  previous  activity  they  *.0  oa  in  it. 

thus,  conditional  optimum  on  the  latter/last  fourteenth 

step/pitch  is  found  for  an^  idx  ji  Ba)  issue  of  the  thirteenth 
step/pitch.  For  each  ol  tneso  .bsuos  it  is  found,  furthermore, 
minimum  fuel  ccnsumpticr  duo  to  wu^ca  or  this  point  it  is  possible  to 
move  in  SnnH. 

let  us  switch  over  to  ^ann*n3/jiiding  cf  next-tc-last 
(thirteenth)  step/pitch,  roi  cu^u>  we  snouid  consider  all  possible 
results  cf  prepenultimate  it«exi *.n>  stsp/pitch.  After  this  step/pitch 
we  can  prcve  to  be  only  in  cu«  ot  tha  points  Cx,  C2 ,  C,  (Fig.  3.6). 
From  iach  such  pcint  we  must  r*nu  optimum  path  in  pcint  S,„,  and 
corresponding  to  this  path  fuel  consumption. 

£> _ f«0H 

r 

13  14 

1 - /7 - 

Fig •  3*4* 
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Page  20. 

For  point  C,  there  as  uu  s«i«ctioa:  we  must  be  moved  cn  the 
horizontal  and  expend  15+17=32  uo.*j.y  of  fuel.  This  expenditure  we 
will  register  in  the  siraxl  c«ccjlo  *icn  point  C,,  and  optimum  {in  this 
case  single)  path  frcm  pcmt  Ct  a^aia  let  us  mark  by  ar row/pcinter. 

For  point  C2  the  select-cu  exists:  from  it  carried  it  is 
possible  to  go  in  ^  ttroua«  w*  curough  Bz.  In  the  first  case  we 
will  spend  13  +  17=30  unity  cx  fu***;  taa  secondly  17+14=3  1  unity.  It 
means,  optimum  path  frcs  Cz  is  vertical  (let  us  note  this  by 
arrow/pointer),  and  mirimum  *.  uai  consumption  it  is  equal  to  30  (this 
number  we  will  register  in  u.e  sn.aml  circle  with  point  cz)  . 


Finally,  for  point  C3  za  into  the  again  single:  cn  the 
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vertical  line;  is  bypassed  j.*.  *ntu  12«-14=26  unity;  this  value  (26)  we 
let  us  register  in  the  ssauu.  c^rciw  wxch  C3,  and  by  arrow  let  us  nark 
optimum  control. 

Thus,  passing  from  cn«  (.Ciui  «.o  ;a«  next  from  rignt  to  left  and 
downward  (from  the  end/leaa  wf  us  process  to  its  beginning),  it  is 
possiole  for  each  node  fig.  j.j  to  select  conditional  optimum  control 
at  ths  following  step  i.e.,  ao  u^reccion,  which  leads  in  SKOH  with 
the  minimum  fuel  cons u a pticu,  ana  to  register  in  the  small  circle 
with  this  point  this  airimum  ext«uuit ure/cons um ption .  In  order  to 
find  from  each  point  the  bellowing  step/pitch,  it  is 

necessary  to  trace  two  possible  tw  pa tns  frci  this  point:  to  the 
right  and  upward,  and  for  e<u.n  t*iu  to  find  the  sum  of  fuel 
consumption  per  this  step  an*  fuel  consumption  per  tfce 

optimum  continuation,  alreau^  constructed  from  the  following  point, 
where  is  directed  pointer  cup.  slum  two  paths  is  chosen  that,  for 
which  this  sum  is  less  (ir  sum  arm  egual,  it  is  chosen  any  of 

the  paths) . 

Thus,  from  each  point  t. g.  o.  o  (sae  page  18)  is  conducted  the 
arrow/point er,  which  irdicac«s  ^uiaw  path  fro®  this  ccint  (optimum 
conditional  control),  ana  .n  tae  smaii  circle  it  is  ente  red/writ  ten 
the  fuel  consumption,  reac&t.a  au  cue  optimum  control,  beginning  from 
this  point  to  the  end/l«aa. 
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iconer  or  later  this  of  cue  construction  of  conditional 

optima  controls  is  finashcu,  aiiek  reaching  starting  point  S0.  From 
this  point  as  of  any  anctntai,  ccnaucts  the  arrcw/pc intar,  which 
indicates,  where  it  is  secesad^  co  oa  moved  in  order  to  reach 
optimally.  After  this  it  la  t.Oaoj.aj.e  ro  construct  entire  optimum 
tra-jectory,  being  moved  on  cue  aiiows/pomters ,  already  from  the 
beginning  of  process  to  its  aUUAaud. 
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Page  21. 

Pig.  1.7  shows  the  fana..  result  of  tnis  procedure  -  optimum 
trajectory,  which  leads  from  S0  *n  on  the  arro ws/pcinters ,  i.e., 

having  from  each  point  cptiiua  continuation.  This  trajectory  is  noted 
by  farty/qreasy  small  circia^  ana  tailcaie  countars.  The  number 
"139",  which  stands  at  point  Sa,  indicates  sirisum  fuel  consumption 
a*,  lass  which  it  cannct  q»  w0'(4U«d  in  what  trajectory. 

Thus,  stated  problem  is  soivtu  ana  optimum  control  of  the 
procass  of  the  gain  cf  altitude  anu  velocity  is  found,  it  consists  cf 
the  following: 

on  the  first  step/fitcn  to  increase  only  velocity,  retaining  by 
constant/ invariabla  height  nu,  ana  to  oriag  velocity  to  V0*AV; 

at  the  second  step/picca  no  increase  height  to  H0*hH,  retaining 
the  vjlocity  of  consta  rt/iu  va  liable ; 


at  the  third,  fourth  auu  a  soaps/ pitches  to  again  gain 


DOC  =  80151502  FiGfi 

speed,  until  it  becomes  6gud^  cc  va+4d/; 

dt  the  sixth,  seventh  a«d  oijuta  steps/pitches  tc  gain  altitude 
and  tj  bring  it  tc 

at  the  ninth,  tenth,  a±ov*uzu  and  twelfth  staps/pitches  to  again 
gain  speed  and  to  bring  at  to  ^xedat  finite  valua 
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Page  22. 

it  the  latter/last  two  attj^/riccaws  (the  thirteenth  and  the 
fourteenth)  to  gain  altatuua  to  ^asec  value  H„m. 

It  is  not  difficult  an  a  uamum r  or  examples  to  ascertain  that 
the  outainad  control  is  act  oar^/reala/  cptinum,  a.  e.  ,  which  in  any 
ether  trajectory,  which  lead^  or  o0  in  5<<m  the  fuel  consumption  will 
be  noce. 

Task  examined  here  cf  uj  w^unus  gam  of  altitude  and  velocity 
is  the  simplest  example  an  w„acu  tney  frequently  demonstrate  the 
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basic  idea  of  dynamic  program  An  t  uaii  y/really,  in  our  simplified 

setting  the  problem  greatly  is  solved  tc  the  end/lead  with  the 

aelp  of  the  simplest  metnous.  iud  is  explained  by  the  following 
circumstances.  First,  at  eau  stor/pitcn  ror  us  it  is  necessary  to 
choose  not  more  than  between  two  versions  cf  control  ("  to  gain 
altitude"  or  "to  gain  spt€u“>  .  ino  da  tar ai nation  or  conditional 
optimum  control  at  eacb  pox  a..  exoiu*»ntarily  and  is  reduced  to  the 
selection  of  cf  core  ac vantUj soua  of  taesa  tvc  paths.  In  the  second 
place,  in  our  task  it  is  vwi^  oxutxe  to  produce  the  numbering  of 
steps/pitches,  beginning  fro*  cu*  ©ni/iaad.  Actually/really,  each 
trajectory  consists  cf  cne  a-u  tx<*  saaa  number  of  steps/pitches,  and 
latter/last,  naturally,  proves  co  ue  taat  which  by  overcoming  one 
(horizontal  or  vertical)  stot/ava^«,  uxcectly,  gives  into  point 
with  uext-to-last  -  that,  a£*.«x  wu*ci  io  point  $*„„  there  remains 
cnly  one  step/pitch  anc,  etc. 

this  simplified  fcrauxa^iou  or  rna  problem  does  not  completely 
correspond  to  reality.  Actually  xxxgut  vesicle  can  to  gather  (often 
it  gathers)  height  and  velocity  s^xul  taneo  usl  y . 

uet  us  try  (furthermore  xa  cue  simplified  form)  to  pose  the 
problam  where  will  be  pxovxd«a  tnxa  simultaneous  set,  and  let  us 
look,  to  what  complications  or  awtaoioiogy  this  will  lead. 
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„et  us  return  to  the  diagram  *.n  Fug.  3.3  and  will  change  it  so 
that,  besides  the  already  a^JUusu  patns  (upward  and  to  the  right), 
from  jach  node  of  grid  wcuxu  u>  t«aSiale  another  path  along  the 
diagonal  of  rectangle  (simuicameous  gain  of  altitude  and  velocity). 
Let  us  supply  the  appropriate  tuw*  consumption  along  each  diagonal 
(Pig.  3.  8)  . 

ih at  does  differ  this  o-.ag^a *  tecs  one  previous  (see  Fig.  3.3)? 
Not  ouly  the  presence,  except  t»o  x s  possible  earlier  controls,  the 
still  third  "along  the  daago^ax". 

Page  23. 

This  liagran  differs  the  las*  pt«w *sa  aumoering  of  the  steps/pitches 
in  ths  limits  of  each  rectangle  uui  taa  rower  laft  angle  into  the 
upper  right  it  is  pcssicla  tw  pas*  bota  tor  two  steps/pitches 
("upward-to  the  right"  cr  "tv  tn»  c  igat-upward")  and  for  one 
step/pitch  -  along  the  dia*o*.ai.  xaer&fora  in  tha  new  task  is 
unsuitable  this  simple  prrac^pxw  wi  consecutive  sorting  nodes,  as 
what  we  took  earlier  (accordant,  t.  a  number  of  steps/pitches,  which 
remained  to  the  end/leaa) ,  sad  *c  .s  necessary  to  take  some  another. 


Let  us  agree  to  label  nodas  act  according  to  a  number  of 
steps/pitches,  which  reiainew  tw  .&«  ead/lead,  tut  according  to  the 
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sign/criterion  of  any  ccccaiudie.  as  tuis  coordinate  it  is  possible 
to  ta«e,  for  example,  "tema-u. dei./^wSi.dis  of  velocity",  ^ 

which  oust  be  "reached"  tec  law  i«iwaining  time.  With  this  numbering 
cf  points  the  "latter"  will  we  taut  atsp/pitch  which  will  translate 
point  S  with  the  vertical  i>uai3ia  line  (a-l)-(m-l)  (Fig.  3.8)  into 
point  S<OB  (this  lattei/laot  "a.wj-/ pitch "  can  consist  of  several 
steps/stages)  ;  by  "next- to* use  o^ts"  -  taat  which  will  translate 
point  with  the  straight  line  (m-i)  -  (m-2)  to  the  straight  line 
(m- 1)  -  (m- 1)  ,  and  sc  forth. 

Fig.  3.9  examines  the  sa a pie/ spa ci men  of  the  optimization  of 
nrocass  with  this  nuiberang  wt  u.  sceps/pitcbes  (ar6  shown  crly  two 
lattar/last  steps/pitches). 


1 
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Page  24. 

Conditional  optimum  ccntrox,  aa  «aiUacr  it  is  shown  by 
arrows/pointers.  Let  us  clarify  t-at  procedure  cf  the  construction  of 
control. 

If  we  proved  to  be  at  a.y  rOi.xt  on  the  straight  line  (m)-(m), 
passing  through  •‘w  that  tae  ouai  possible  (the  very  sane  and 
optiaun)  path  of  output  xnro  pu^.hw  S*„„  -  but  vertical  line.  This 
path  is  shown  in  Fig.  3.9  uj  ax*.ows/p oxnta rs  cf  lengthwise  entire 
straight  line  (m)-(n);  the  cwrr«~st.onixug  fuel  consumption  are  shown 
in  th a  saall  circles. 
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Get  us  assuae  new  tnat  as  a  result  of  the  process  cf  the  gain  cf 
altitude  and  velocity  we  proved  to  Pa  on  the  straight  line 
(a- 1)  -  (a- 1)  .  He  will  sext  cu*.  wuis  straight  line  all  points  on  top 
downwardly.  If  we  preved  to  we  ..n  tna  gaite  peak,  then  path  into 
point  SHOM  hence  single  (horizontal)  i-i  oy  passed  it  in  17  unity  of 
the  fuel  (we  write/reccrd  17  m  uw  saall  circle  and  we  place 
horizontal  arrow/pointex) .  •«.  pas*  to  in*  following  point  -  the 
seccnl  on  top.  Frca  it  to  t*m  ai^a^gat  line  (s)-(b)  -  three  paths. 

The  first  path  -  upward  -  to  tn«  ..igut  -  is  bypassed  into  13*  17=30 
unity  of  fuel;  the  second  -  a lona  tha  diagonal  -  in  29  unity;  the 
tairl  -  tc  the  right  -  upward  -  i«  11  unity.  He  chocse  diagonal  path, 
we  aark  by  its  arrcw/pcint«r#  a-a  the  corresponding  consumption  -  29 
unity  -  we  place  in  the  snaa.-  cixcib.  For  the  third  point  we  are  on 
top  again  congruent/eguata  patas: 

upward  (and  further  axo*.g  in*  diagonal):  12*29=41  unity  cf  fuel; 

with  respect  to  the  dxa^cuai  ^aad  further  upward):  25*14=39 
unity  of  fuel; 

to  the  right  (and  turxn«r  to?):  1u*26=41  unity  of  fuel. 
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tie  choose  optimum  (au  -  ttu  dxagcral,  we  note  by 

arrow/pointer,  we  write/ recu* u  *n  tae  small  circle.  For  the 
following  -  the  fourth  cn  ic,  -  ^..nt  ^n  the  straight  line 
{ at—  1)  —  { 1 )  optimum  will  oe  .aw  ^ath  upward  and  so  forth. 
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Page  25. 

Pig.  3.10  gives  the  fin«  i.  .a«ul.!>  or  the  optiaization  of  control 
of  th  i  gain  of  altitude  aau  vex uc^ty  under  given  conditions, 
indicated  in  Pig.  3.8.  Optima  j  jestocy  is  as  oetora  isolated  with 
fatty/greasy  snail  circles  a«d  i«  counters. 

ieing  co ngr uent/equatin^  u.  uptiaua  trajectory,  shown  in  Pig. 
3.10,  with  that  that  is  giv»«  *.  xg,  i.  7,  we  nets  that  they  are 
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distinguished  not  very  cot  s*.co As  far  as  fuel  consumption  is 
concerned,  then  its  values  (iJo  a*s  Id*)  entirely  diffar  little  from 
each  atber,  and  both  centroid  c*u  ue  cousidered  ia  effect  equivalent. 

In  the  example  exasineu  **  jcie.’tdJ  the  method  of  the  ordering 
of  st aps/pitches  "on  the  ao.i.  issa".  ra.s  aethcd  is  not  completely 
necessary;  it  would  be  possi^la  to  lausl  steps/pitches  also  in  terms 
of  tha  values  of  any  ancttwr  coordinate.  As  this  coordinate  cculd  be 
with  the  equal  success  seLac-ia  uaigat  rt.  Perhaps,  in  our  exasple  the 
most  natural  "ordering"  cccrojaata  wound  oe  distance  from 
deposit ad/postpcnei  in  parao-.*.,  tie  diagonal  of  basic  rectangle 
(Fig.  3.11). 
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Page  26. 

To  reader  cne  shcula  uj  «r  axarcise  find  optimum  trajectory 
according  to  the  data  cf  Fi^«  j.o,  using  chat  method  cf  the 
adjustment  of  steps/pi tebes  »  hxca  is  demonstrated  in  Fig.  3.11. 

In  the  diverse  tasks  or  tne  a^naaic  programming  where  there  is 
no  natural  distributi.cn  into  uin  otaps/ pitches,  the  principle  of  this 
distribution  and  orderirg  or  sce^s/pitoh es  is  chosen  depending  on 
convenience  in  the  ocjanzaucu  o*.  computat  icnal  process,  taking  into 
account  to  the  required  acui.ac^  «r  tad  solution  of  protleo.  Is 
generally  intuitively  it  is^laai  cha-t  with  at  increase  in  the  number 
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of  st aps/pitchas  the  accurac,,  or  «-ue  solution  grows.  In  some  tasks  it 
proves  to  be  possible  tc  cut-in  o*en  limited  solution  with  a— this 
solution  can  represent  tnwuu  ciua^t  na  sometimes  also  practical 
inter  ist;  however,  usually  i».  io  to  sufficient  explain  the  structure 
cf  optimum  control  in  the  a«...  eta.*./ common /total ,  rough  features;  in 

this  case  there  is  nc  need  to  str«,«giy  increase  a  number  of 

steps/pitches.  The  same  witt  tn«  practical  realization  cf  control 
most  frequently  fits  nevertncless  to  stap  back  from  the  strictly 
optimum  version  which  car.  pr<-  va  «.w  bu  difficultly  tc  feasible. 
Therefore  we  will  not  pause  «n  uie  maximum  tasks  ot  control,  which 
appear  with  ra->-,  tut  we  wxlj.  o«  mounded  to  the  examination  of 

discc ate/digital  step  fcy  ste*.  u^a^iam.  This  especially  nakes  sense, 

that  in  many  tasks  of  the  wcoaomio  plaamag/glidiny  {but  we  will  give 
to  similar  tasks  considerate*,  attoutiou)  distribution  into  the 
steps/pitches  net  imposed  rrom  outsiia,  out  it  is  logically  dictated 
by  th i  discrete/digital  nature  or  the  pianning/gliding  itself  (ylane 
is  comprised,  for  exaiple,  l1  tte  ^ear,  to  the  month,  etc.,  and  it 
does  not  vary  continuously  Xu  tee  course  of  production  process). 
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lq  •  4.11. 


§  4.  Problem  cf  the  selection  or  *.ne  fastest  path, 


In  the  previous  paidyiarh  w*  considered  in  the  simplest  setting 
the  tusk  of  the  optimuB  gain  c:  altitude  and  velocity.  Here  he  will 
consider  similar  in  the  ty^e,  uu  nevertheless  differing  semewhat 
from  *t  task  of  the  selectxo..  or  cne  fastest  path  of  cne  pcint/item 
in  anJthec. 


Page  27. 

Task  is  placed  in  the  roixoe^ng  manner.  Let  it  be  we  should 
raach  in  the  machine  frea  pc*nt/.».,.em  3o  to  point/item  S*o„  (fig. 

4.1).  Generally  there  is  a  h„ci«  a«rras  of  pcssiole  versions  of  path. 
They  are  comprised  of  the  sv^ucua  of  ways,  net  equivalent  or  the 
quality.  Among  them  there  ca.  u«,  ..or  example,  the  sections  cf  the 
first-class  asphalted  highway. 


aau  arso  tne  less  we 11-organi 2ed  and 
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siapL/  unimproved  roads.  on  the  path  tc  us  can  be  met 

the  crossings  and  the  passers  c.  whica  tae  action  is  detained. 

Task  lies  in  the  fact  ii.au  to  salact  this  path  from  S0  and  ^»u»> 
which  machine  will  pass  tex  . .ne  duUJU.ii  time. 

Task  at  first  glance  .a  covi^e-ta  1/  similar  tc  that  examined  in 
the  previous  paragraph.  However,  *t  nas  some  special 
features/ peculiarities.  In  examples  3  i  we  constructed  the  regular, 
rectaagular  grid  of  the  nca«-»  tniouga  which  cculi  pass  trajectory. 
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Page  28. 

In  the  new  task  which  w«  exae-ia**  now,  the  role  cf  this  grid  cf  nodes 
could  play  the  logically  notau  "itAiigaiar  points"  of  tfce  netwcrk/grid 
of  ways  -  crossings  and  passage.®,  on  taay  were  arranged/located  too 
irregularly,  and  it  is  ca.fz.u.dAC  "to  order  them  on  the 
steps/pitches".  In  order  to  apt^oxiaa  tal  y  solve  our  task  by  the 
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methoi  of  dynamic  prcg  taauaiii3 ,  xt  is  possible  tc  introduce  into  it 
artificially  certain  "  stage-wy-sm^e  cnaracter".  For  example,  it  is 
possible  to  divide  distacce  ut  u  orn  Ja  to  S„OH  intc  m  of  equal 
parts  length  AD=C/m  (Fic.  4.2)  a**u  to  consider  that  fee  each 
"step/pitch"  of  the  process  or  ai^*- lac  a  men  t  from  30  in  is 

surmounted  the  m  part  ct  discuace  l  (in  me  direction  .v,,  —  SXIIII).  in 
ether  words,  each  "step/ pit  c*»"  is  displacement  with  one  of  the  lines 
of  support,  perpendicular  —  •$„„„•  to  tae  adjacent,  the  closer  to 


Jale  process  to  the  step s/ pitches  tnus,  we,  naturally,  trust 
agree  that  the  displace  lent  .rom  cue  step/pitch  to  the  next  is 
allow ad/assumed  only  ir  the  t  csitxve  direction  (i.e.  from  S„  to  S.ni. 
and  not  conversely) ;  ir  ctnei  weeas,  alter  the  specific  step/pitch  is 
travail  od,  return  conversely,  rum  tae  same  band  between  two  lines  cf 
support,  is  not  allowe d/assumea.  mis  limitation  occurs  sufficiently 
to  acceptable  ones  fer  the  ^  acuc#.  Let  us  recall  that  in  the  task  § 
3  we  met  with  even  the  icr«  ^v»io  limitation:  in  the  mcde/ccnditicns 
cf  climb  and  velocity  was  aij.ow»u/ ass umea  the  displacement  over  both 
axes  only  in  the  positive  ui^eumc u.  In  me  task  of  the  selection  of 
the  fastest  path  that  ictrouuc«u  my  as  limited  (as  a  result  cf  each 
step/pitch  to  be  moved  calj  "cneia”,  oat  to  direction  S0  —  S,oir  and 
nof’back  ")  is  less  rigid,  *Uwce  it  functions  only  from  one 
step/pitch  tc  the  next,  net  <uu.a  tae  step/pitch,  and  moreover,  only 
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cn  onj  axis  (in  the  case  o*.  udCwa^t/  from  this  limitation  it  is 
possiole  to  be  freed,  cc  ii  .a**  uc.sa  one  solution  strongly  it  is 
complicated) . 

thus,  let  us  assure  tna*.  tr*  raca  from  s0  in  is  decomposed 

into  j  of  the  steps/pitches,  in  due h  or  which  tfca  machine  is  moved 
with  one  cf  the  lines  ci  su^Otr  (j.)-(i)  to  the  following  in  order 

i /  — 1 )  —  (i'-f-1)  (7  =  0.  I . m). 

fhe  carried  out  by  us  x+uea  ui  support  intersect  read  net  at 
seme  points. 

Page  29. 

For  tae  solution  cf  problem  *.0  us  must  oe  known  the  time,  required 
for  tne  passage  of  each  sect~.cn  or  patn,  and  also  delay  time  on  each 
crossing  (passage).  In  Fig.  •♦.*  agoiust  each  route  segment  is  written 
the  corresponding  time  cr  paasn^e  tin  wh«  minutes),  and  in  the  small 
circla  in  each  crossing  (passage)  -  latency  cf  machine  in  this 
point/item. 

According  tc  a  quantity  or  r^nes  of  support  in  Fig.  4.2  process 
cf  tho  displacement  cf  aacni.»a  i  q  in  ^xoh  w a  will  share  info 

seven  steps/pitches  (i.c.  let  ua  taka  j*7)  and  let  us  begin  the 
construction  of  optimum  patn  hum  tha  latter/last  ( a  —  t h )  step/pitch. 
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uet  us  plan  cn  the  lino  or  surpor;  (a-l)-(ir-l)  all  possible 
positions  of  machine  at  tne  mOiaau*.  of  ta«i  termination  of  next-t c-last 
(m-i)  step/pitch.  This  wilw.  u*  aj*utaases  about  tne  state  of  machine 
afterward  (m-1)  step/pitcn,  ..or  each  of  waich  we  must  find 
conditional  optimum  ccrtrow.  ^a  m  stop/pitch.  In  Fig.  4.2  these 
possible  position  are  ncteu  b«aii  circle  with  the  point  inside. 
From  aach  such  position  we  must  ouova  apiiium  (saoctest  on  the  time) 
path  into  point 

wet  us  consider  first  n^st  (on  top)  of  the  notaa  points  - 

point  A  on  the  straight  line  ^m-l^-la-1).  From  it  into  point  S.™  (in 
the  limits  of  the  band  of  *  o^p/ p*tch )  conducts  cne-single  path, 

which  occupies  on  the  time  10e2«-1>5  +  1 1}*2*5=35  (minutes). 

Che  selection  cf  this  crauiticnal  optimum  control  when 

the  previous  step/pitch  leu  us  rare  point  A.  Let  us  note  in  Fig.  4.2 
this  optimum  path  by  tlacx  neaw^  ixna,  and  in  point  A  let  us  display 
"flag1*  with  registered  uta  c  ua  ait  Jo. 

deavy  line  together  wit*,  cum  ill  g  taoy  indicate  the  following: 
if,  bjing  moved  from  s0  in  •  «  soma  fates  they  proved  to  be  at 

point  A,  then  of  it  we  i  ust  iOv«  wurthor  over  the  noted  by  black  line 
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routa  and  on  the  achievement  or  roinc  ?<n„  cf  tha  expenditures  of  35 
minut  as. 

Me  pass  to  tha  fcllcwin^  ro.ui.  (8)  on  the  straight  line 
(a-l)-(m-l).  Frcir  it  into  pu-.u.-  ^«n„  conducts  the  cr.e  and  only  path, 
to  which  it  is  required  2***  1  +o  + lu +  2+  5=  27  (ainutas) .  Number  27  we 
also  write/record  on  tie  ix*j  next  to  point  8. 

For  point  C  the  path  again  single  and  is  continued  4+2+5=11 
(minutes)  . 

From  point  K  in  s„m  ta«re  a*.o  t  mo  paths;  3  +  3  +  4=10  (minutes)  and 
3  +  3+2  +  2+6=16  (minutes)  ;  or  uew  tn»  first  -  fastest;  we  note  ty  its 
heavy  line  and  we  write/raco.  d  mia^mum  time  (10)  on  the  flag  in  point 
K. 
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Kay:  (1).  river.  (2).  ferry  -Oa*.  iJ>  .  Railroad.  (U).  a  step/pitch. 

Fage  J1. 

Continuing  thus,  he  finu  lol  ea :a  point  cn  the  straight  line 
(a-l)-(a-l)  the  optimum  con ....  a  uat-.cn  or  path  -  conditional  optimum 
control  at  the  m  step/pitcn. 

After  this  is  carried  out,  Me  piss  toward  planning/gliding  of 
(a- 1)  step/pitch.  Hypcthes«s  uuout  tnat,  where  can  be  located  the 
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machine  of  afterward  penpenu.. uitau  (m-2)  step/pitch,  they  are  noted 
by  triangles  on  the  straignt  lxn«  im-  2)  -  (  m-2) . 

?or  each  of  the  noted  we  oast  find  conditional  optimum 

control,  i.e.  ,  this  path  wxt«  cue  otraxgat  lire  (m-2) -(m-2)  tc  the 
straight  line  (m-1)-(  ra-1),  wa*cn,  togataer  with  the  already 
optimized  latter/last  step/ tea,  ^i/ai  tae  pcssifcility  to  achieve 
5«m<  for  the  minimum  tine,  x..  oeUeu  to  fxnd  this  conditional  optimum 
control,  we  must  for  each  on  tne  straight  line  (m-2)- (*-2)  sort 

cut  all  possible  transition  nones  to  toe  straight  line  (m-l)-(m-l) 
and  time,  required  tc  tnis  u duaiuca ,  sum  with  the  minimum  time  of 
lattar/last  step/pitch,  re*xst«ieu  witn  the  flag.  From  all  possible 
paths  is  chosen  that,  fcr  kuj.cu  tnxs  total  time  is  minimal;  path  is 
noted  by  black  line,  ana  txun,  xo  Wiictan/recorded  on  tne  flac  in  the 
corresponding  point. 

4s  a  result  of  the  cnaxu/notwor*.  of  such  constructions,  being 
moved  step  by  step  with  cos  j.iu«  or  support  tc  another,  we  finally 
will  reach  starting  point  s0.  ror  *t  we  will  determine  optimum  path 
to  the  straight  line  ( 1 )  —  (1 ;  duu  Act  us  register  the  appropriate 
minium  time  (87  minutes)  cn  tut,  ^j.ag  at  point  S0.  Thus,  all  data  for 
the  construction  of  optimum  *.a cn  tnece  are,  since  fcr  each  of  the 
planned  points  (whatever  fntss  w«  j.n  it  not  they  proved  to  be)  is 
known  the  optimum  continuation  ox  ^ath.  In  order  to  construct  optimum 
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path  from  S0  in  S*<m-  it  is  u«c^**ai.y  simply  tc  te  novel  on  the 
sections  of  ways,  noted  by  x-.ads.  in  Fig.  4.2  optimum 

trajectory  from  S0  in  ^«w  uoteu  ay  heavy  line  with  the  dotted 
line. 


Thus,  stated  problem  acuuc  u«  selection  of  the  fastest  path 
betwean  two  preset  pc ints/ir.« m*  .a  soi/ad. 

Apropos  of  this  task  it  is  t-oasibie  to  express  several 
consi  lerations,  which  ccoceu  tae  aelacticn  cf  a  number  of 
steps/pitches  during  the  cei*  ti  ucixoa  of  the  solution  by  the  method 
of  dynamic  programming. 

Fage  J2. 

It  at  first  glance  seem*  sn  taat  the  solution  would  be  more 

simply,  it  would  be  desiraaie  aave  a  little  less  steps/pitches. 
Howevar,  this  net  entirely  tx>u*.  me  larger/ccarser  the  step/pitch, 
the  more  difficult  it  is  to  xiou  tue  optimum  solution  on  this 
step/oitch,  the  more  there  i*  ta*»  versions  cf  the  displacement  with 
the  straight  lire  tc  the  suiaigat  xina.  In  the  extreme  case,  if  we 
considered  only  one  step/piton  oerore  ts  would  arise  the 

initial  task  of  sorting  alx  poseiwie  paths  from  S0  in  in  her 

entira  cctplexity. 
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It  does  fellow  fees  cna©  iu  our  specific  problem  it  was 

necessary  to  still  increase  a  uu*ur  of  steps/pitches,  to  do  then, 
for  example,  not  7,  tut  wU? 

Also  no  !  An  increase  Xu  tee  number  of  steps/pitches  beyend  sene 
reasonable  limits  would  cm/  cja^i^cati  tae  procedure  of  the 
construction  of  the  sclcticn. 

In  the  fact  that  the  auecuu  by  ns  number  of  steps/pitches 
(a=7)  is  sufficiently  rsascnaOxe,  mS  possible  tc  be  convinced  on  the 
fact  that  for  us  was  newher©  n«c»»ac  y  tc  sert  cut  a  large  number  of 
versions  cf  transition  wxtn  >.a«  ©txaxgnt  line  tc  the  straight  line  - 
thesa  versions  proved  tc  a©  ©a©,  xwc,  ire  rare  three,  and  to  find 
among  then  optinun  was  net  twC  act  difficult.  If  we  strongly 
incraused  a  number  of  steps»/c  ucnwa ,  i.e.,  is  excessive  refined  the 
sections  cf  transiticr,  town  in  tu©  ovurwaelning  majority  of  the 
cases  with  the  straight  line  to  to©  straight  line  wculd  conduct  one 
and  only  path,  and  nc  c p tiauxatxcu  it  would  be.  As  the  final  result 
we  would  construct  the  same  u(uiuh  trajectory,  on  ty  mere 
complicated  calculat iens. 

§  5.  Continuous  task  cf  plotting  ui  optimum  route. 
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In  §  u  was  solved  the  c«*s*  vt  pi.oita.ng  of  cptnui  route  from 
pcint/iten  50  to  point/item  5,.nil  <uea  jotn  points/items  were 
connected  by  some  aetwcik/^t^d  or  ^ays  ana  path  can  run  only  cn  one 
cf  tha  ways  of  this  di  screta/ a*  3^.wal  grid. 

In  practice  can  be  set  anouisi  situation  -  whan  finished  read 
net  tnere  does  not  exist,  ou*.  ai*«ati.ca  or  motion  from  each  pcint  on 
the  plane  can  be  chosen  arui.  uiixj ,  fur  axample  in  the  limits  of 
some  angular  sector  9  ( F i  j .  j.lj.  ±n  tais  case  for  aacn  point  A  on 
plane  xOy  is  known  the  veaoc-ty  or  displacement  from  tnis  pcint  over 
any  ray/fceam  AA'  withir  the  *ia*ta  or  sector  6. 

Page  13. 

Task  lies  in  the  fact  that  tv  unu  sucu  trajectory  U*,  which  combines 
S 0  ani  along  which  pout  j  would  pass  frem  50  in  S>„„  within  the 

short  time. 

„et  us  plan  the  diagram  o..  tuc  soiuticn  cf  this  prcbl6m  ty  the 
methol  of  dynamic  programing.  10*.  simplicity  let  us  assume  that  the 
sector  9  is  symmetrical  relative  tv  line  A3,  parallel  tc  the  axis  of 
abscissas,  and  that  9<160°  (.au»i  is  accessary  in  crdei  to  exclude 
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the  lisplacaraents,  Mre?eiSo"  to  ue  iirecticn 
abscissas) . 

«et  us  deccapose  distan-a  ^*oM  —  Sn  mtc 
the  process  of  overcoming  ta*s  ai-ataucu  -  tc 
each  of  which  is  transition  wi».u  oue  of  line 
axis  ordinates,  tc  another,  aOjaCeut  (?iq.  5. 


of  the  axis  of 

cf  equal  parts,  and 
cf  the  steps/pitches, 
f  support,  parallel  to 

)  . 
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Page  J4. 

If  we  take  a  number  cr  »urii^iccae3  a  sufficiently  large,  then 
it  is  possible  tc  assume  taai  at  eacn  step/Fitch  the  trajectory  phase 
is  straight-line-  Task  is  reaucta  *.oc  aaca  point  A  cn  the  line  of 
support  (i-l)-(i-i)  tc  aet«r»ii*®  ua  optiaun  angle  *  (in  the  limits 
cf  sector  9),  at  which  ausv  roiat  A  optiaum  trajectory,  i.e.. 
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that  jut  with  which  we  fust  ^jva  i<.o»  A  in  crder  to  achieve  .v . .  in 

the  minirau#  time.  If  we  ta«  ^Coitj.un  of  point  A  cn  the  straight  line 
(i-l)-(i-l)  determine  hy  its  cravats  y, _ , .  the  conditional  optimum 
control  at  the  i  stap/pitcu  *114.  jo  aoiion  from  point  A  at  angle 
toward  the  axis  of  the  abscissas  wneca  f,"  lefer.ds  on  _ T- 

W*0’<-i>  =  fiO'f-i). 

<ie  will  plan/glide  tno  ^rocoso  of  displacement,  as  always,  from 
the  latter/last  (m-th)  stSf^itca.  La t  us  assume  that  as  a  result  of 
(a-1)  step/pitch  we  prcved  to  j«*  &«.  oactam  pcint  3  on  the  straight 
line  (m-l)-(m-l)  (Pig.  5.2;.  mato  we  must  move  further  in  order  to 
prove  to  be  at  pcint  S.„„?  iw  ojvious,  on  straight  line  BS.olt ■  But 
direction  of  this  notice  not  toi  as.  1  positions  cf  pcint  B  on  the 
straijht  line  (m-l)-(m-l)  it  is  louni  within  the  permissible  limits. 
In  or  ier  to  construct  segment  jl of  the  possible  positions  cf  pcint 
3,  whence  it  is  possible,  aui  Hj  uui  limitations,  tc  arrive  in  5*„„. 
obviously,  it  is  necessary  tw  construct  trem  point  S,mt  the 
'’inverted"  sector  9;  its  focueis  «j.1i  cut  off  on  the  straight  line 
(m-l)-(n-l)  segment  EjG2. 

Thus,  for  each  pcint  j  outtin*  off  3j  Ba  is  found  conditional 
optimum  control  -  dis p lacemau c  wv*i  straight  line  BSH,m  at  angle 
co  the  axis  of  abscissa.*,  ■n-.oh  impends  cn  ordinate  of 


point  B: 


—  (v„  _i)- 
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Knowing  the  velocity  or  dz*tj.a.c*  uat  from  point  E  over  this 
direction,  we  can  find  tfce  uu.  c^iu  m  tiii  c t  the  execution  of  the 
latter/last  stap/pitch: 

T m  —  Tm  (y„  _  |). 

Thus,  for  any  Feint  8  <u.  cue  stcaigat  line  (a-l)-(m-l) 
conditional  optimum  ccntrou.  abu  tti. responding  tc  it  conditional 
minimum  time  cf  the  m  step/p^tcn  can  ba  determined. 

Page  35. 

L at  ui  assign  several  values  cn  owiaata 

y"  ,,  yJ>  ,  r  , . 

and  for  each  of  them  let  us  Uuu  conditional  optimum  control  and 
conditional  minimum  time: 

T'M r;(yi?_,);  ... 

If  points  /"_r  y*  . . .  <*re  s«o  on  cutting  cff  BiB2  sufficiently 
frequently,  than  it  is  poss^uie  tc  consider  that  the  conditional 

optimum  control  and  ccna:Uut.au  minimum  time  are  f  c  and  for  any  value 

y™— I* 

Get  us  switch  over  to  t-*auuti.«a/j  iidiag  of  cext-tc-last  (u-1) 
step/uitch  (Fig.  5.3).  Section  Ctc2  of  taa  possible  pcsiticns  of 
point  S  as  a  result  cf  (m -2\  sto^/fitca  is  also  determined  by  the 
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"inverted"  sector  9;  in  eras.  xt  to  construct,  it  is  necessary  to 
continue  straight  lines  a**u  5K0),5,  before  the  intersection 

with  the  straight  line  (ir-ij-  .  Let  us  place  in  section  CjC*  the 

serias/rcu  of  reference  points  ana  far  each  of  them  let  us  find 
optimum  path  in  Per  poiuc  «-!  this  path  is  clear:  it  joes  on 

straight  line  (^Sknil.  Let  us  xdaa  tris  patn  fcy  heavy  line  and  it  is 
computed  corresponding  tc  it  ruxx/tocal/co n plete  time  r’„. 
expen  lad  for  the  execution  Ox  ;»u  xattsr/iast  staps/pitches. 
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Page  i6. 

This  cine  is  equal  tc  the  sue  s j*.  two  t^mes :  time  <’»- >  cf  the 
displacement  over  cutting  or*  and  of  tiae  T’m  of  displacement 

from  3 1  in  s,OH  (but  it  was  ixiaaay  calculated  on  the  previous 
step/pitch)  .  Analogously  opuaais  r<tu  rroa  C*  in  <?»«,  goes  cn 
str ai g ht  line  CyS„„. 

let  us  talce  cn  cutting  dr  CtC2  any  internal  pcint  C'.  For  this 
point  path  to  the  straignt  line  i*- 1)  -  i«- 1 )  no  longer  single. 
Actually/really,  after  ccitat*  vitu  point  C'  tha  sector  cf 

possiole  directicns  6,  we  see  tnet  witnin  the  liaits  cf  this  sector 
it  is  possible  to  select  any  rectilinear  path,  which  leads  frca  c ' 
into  one  of  the  points  cutting  or*  3j  3'  , . 


By  what  fic»  these  paths  to 
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select?  it  is  obvicus,  tuac  catu  *- '  D,  for  which  the  total  time,  which 
goes  co  both  latter/last  sts^s/i-i^ohas  (C'D  and  DS,W).  is  nininal. 
Let  its  designate  this  tinrau-  ti.au  T'm_K m  and  let  us  note  that  it 
depends  cn  ordinate  y*-;  Oj.  Taking  whole  range  of 

different  positions  cf  porac  C'  ca  cutting  off  CjC2  with  ordinates 

y^'.j.  2 .  let  us  tana  «.a  each  of  taen  cptimun  control  ?^-i 

and  nininun  time  7"^-i.«  or  w a«  acaiavament  of  point  ^«o«: 

r;.,.,(y r;.lt 

After  this  is  dene,  we  pass  towatu  piannrng/gliding  of  (n-2) 
step/pitch,  etc. 

is  a  result  cf  the  char*./ act  wort  or  such  constructions  fer  each 
point  on  any  of  the  lines  or  surt-ort  wixl  be  explained  the 
conditional  optimum  ccntiox  (ju>  round  th*»  angle  **,  at  which  it  oust 
pass  optimum  trajectory)  ana  rs  uoteroraeJ  corresponding  to  this 
control  minimum  time  of  tn«  acu.a^iin;  of  point 

After  the  process  cf  opiidissatiJn  is  led  to  point  s0,  is 
constructed  (already  frea  tn„  u***i.arag  toward  the  end)  entire 
optinun  trajectory,  which  rrjn  *>acn  point  gees  at  optinun  angle  •  *. 

?ig.  5.4  shows  the  result  or  tha  construction  of  optinun  control 
by  the  method  of  dynasic  pr oa  casuung.  jptimun  trajectory  is  rcted  by 
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heavy  line  with  the  dotted  i*n«. 

Page  J7. 

Let  us  note  in  ccnclubicu  uat.  the  described  methodology  of  the 
construction  of  optiiuir  tiajaccu^  completely  dees  net  depend  on 
that,  what  precisely  value  aired  -  be  it  time  T  cf 

displacement  frets  s0  into  SHM.  mj.iuac  the  fuel  consumption  R  cr  of 
costs/values  of  passage  C,  c*  any  criterion,  selected  depending 

on  the  character  cf  the  deciaeu  practical  task.  For  example,  with  the 
packing  cf  railway  line  it  x*  tc  prefer  that  route  which 

leads  to  the  smallest  expend tui.es  or  cue  saallest  volute  of 
earthwork,  when  selectirg  or  ai*i»*j.e  trajectory  can  prove  to  he 
necessary  minimize  the  launcuiad  wwignt  or  asaxinize  velocity,  etc. 

let  us  note  also  that  t«a  *%wior  or  possible  directions  9,  which 
we  foe  simplicity  considered  co instant /in va riafcle,  can  vary  depending 
on  the  number  of  step/piten  or,  i.  general,  from  the  coordinates  of 
starting  point  A.  In  scie  ^taCt.coj.  ras*s  it  occurs,  that  direction 
the  velocities  at  the  initial  accent  or  intc  the  final  (or  into  both, 
etc.)  are  preset  previously  ana  vary  cannot.  This  is  equivalent  to  so 
that  the  sector  of  possible  dix«c«.ioas  9  in  the  vicinity  of  these 
points  is  degenerated  irtc  o^a  sti.aiy.tt  line. 
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deference  lines  «aich  *e  shared  process  into  the 

stages,  ccapletelv  oust  act  „«  «ou»  straight  lines,  parallel  tc  cne 
the  axes;  the®  are  cbcsen,  c**  ci.«*  uasis  of  convenience  in  -the 
construction  of  ths  sclttion. 
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Page  18. 

If,  fur  example,  the  tas<  me*.  a  cc..  veaiently  deciding  not  in  the 
Cartesian,  but  in  the  pciar  s.cota*,nate  system,  line  (i)-(i)  they  can 
be,  depending  on  type  the  La*>ts,  ate  selected  in  the  form  of  light 
beam,  which  proceed  fret  por«  o  cr  in  the  form  of  the 

concentric  circumferences  i*.*g.  b.  o) .  For  example,  Fig.  5.7  shows  the 
schematic  of  p lanning/glidia *  cna  output  of  cccket  treo  point  S0  cn 
the  earth's  surface  to  the  g*.  w«*»  roiat  5„W1  of  cuter  space,  carried 
out  ia  the  polar  coordinate  C na  polar  coordinates  of 

launcaing  point  S0  ace  preset  us  a  equal  to  (#,.  -it.  The  ccnditicns  of 
the  varticality  of  start  narrow  cue  sector  of  possible  directions  9 
at  tha  first  step/pitch  to  c*e  st*aignt  line;  the  conditions  for  the 
preset  direction  of  final  vs^ccst;  ''•»«  set  the  same  limitations  on 
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the  litter/last  step/pitch;  at  «.u<n  intermediate  steps/pitches  of  the 
limitations,  superi  up  c  s  <  d  iu  tn«  a«ctor  cc  possible  directions,  they 
are  i arived/ccncluded  ficm  ui  rujoical  considerations  (for  example, 
from  the  maximum  permissible  ttwave; 34  transfers  of  rocket). 
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§  6.  Jeneral/coamcn/total  ro.  auxauion  or  the  problem  of  dynamic 
programming.  Interpretation  w r  control  is  the  phase  space. 

After  is  examined  tee  s«xi*a/icw  or  the  specific  problems  of 
dynamic  programming,  let  us  3iv»»  ana  gaaeral/ccomon/tctal  formulation 
of  such  problems  and  will  zu laioce  in  general  form  the  principles  of 
their  solution.  In  this  paxd3rarn  (and  in  the  following  after  it  §  7) 
for  r  aadei ,  familiar  crly  wi-n  ia.  eiauiants/cells  of  advanced 
calculus,  it  is  necessary  to  czaau  witn  an  not  entirely  customary  for 
it  recording  of  formulas  ana  a  aoifcwaat  unusual  terminology.  However, 
let  us  emphasize  that  tr.a  ca.sc.aua  mastering  of  precisely  these 
paragraphs  is  very  substantial  tux  the  unuersta rding  cf  the  method: 
without  this  general/ccamcn/cctax  approacn  will  be  difficult  to  see 
in  the  following  presentation,  aiywolag  larger  than  the  set  of  diverse 
examples. 


net  us  consider  following  general  problem. 


There  is  certain  physical  ^yatai  s,  which  in  the 
can  vary  its  state,  we  can  Banana  this  process,  i.e., 
other  way  to  affect  the  state  oz  cistern,  to  translate 


course  cf  time 
in  this  or  some 
it  of  cne  state 
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iato  Another.  This  system  :>  -e  wu-n.  sail  the  controlled  system,  and 
action,  with  the  help  cf  wnich  we  affect  the  fcehavior  of  system,  by 
central. 

With  the  process  cf  ci.au gin^  tha  state  of  system  5  is  connected 
some  jf  our  interest,  whaca  «s  cij/uessad  numerically  with  the  help  cf 
criterion  V,  and  it  is  tecdtuarj  u.  organize  process  so  that  this 
criterion  would  become  lauauB  *. 

FOOTMJTR  Subsequently  for  ta«  uiev  ity  we  will  speak  only  about  the 
maximization  of  criterion,  u that  the  "maximum"  in  any  event 
can  dj  substituted  tc  the  "au, m>uu* ".  iSSdf c ctnct E. 

uet  us  designate  cir  couicu  (i.  e.  entire  system  of  actions  with 
the  halp  of  which  we  we  afreet  ta«  state  of  system  S)  of  one  letter 
TJ.  Criterion  H  depends  cn  tiu.s  central;  tais  dependence  we  will 
register  in  the  form  of  tae  uiiiua 


Page  40. 

It  is  necessary  to  find  seca  cjuuwI  (J*  ("optimum  control"),  during 

which  criterion  w  reaches  u«  eax^oium: 

W*  =  max  (NF  (U)\.  (fi.2) 

u 
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Sacoriing  max  is  raad:  "sd^nuit  <ju  J”,  and  formula  (6.2)  indicates: 

r 

4*  is  maximum  frcm  the  valuer  mi.u  ta<s  criteria  W  during  all 
possible  controls  rJ. 


Jowever,  the  problem  a  taa  optimisation  of  control  is  net 
coBplately  yet  posed.  Usuaax^  uto*»  taa  tcraulaticn  cf  such  problems 
must  oe  taken  into  consider at iom  soma  conditions,  superimposed  on  the 
initial  state  of  systeir  sQ  a*.a  Uual  state  In  the  simplest  cases 

both  these  states  are  ccapASoei^  riesec  (as,  for  example,  in  §  4, 
when  it  was  necessary  tc  txaas.*.as.«  true*  frcm  pcint/item  s0  tc 
point/itea  $*on)-  In  ether  ta.*<s  u»se  states  can  be  preset  ccmpletely 
accurately,  but  it  is  ctly  ju.ait*u  oy  some  conditions,  i.  a. ,  are 
shown  the  region  of  the  anat^aa  ^tatas  T0  and  the  region  of  final 
states  S.n„. 

Che  fact  that  the  iflit-u.  i  state  or  system  S0  enters  into  regicn 
S^,  wa  will  write/recora  tatu  tas  aelp  or  the  accepted  in  mathematics 
"sign  of  inclusicn/ccnnectiou "  6 '• 

it  is  analogous  for  the  t max  ^uu: 

Sunn  ^  inn ■ 

raking  into  account  aaxcaax  and  final  conditions  the  task  of 
cptimua  control  is  fcrtrtlat*u  as  follows:  fees  many  possible  controls 
0  to  find  such  ccntrcl  l*,  w^ica  translates  the  physical  system  S 
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from  initial  state  i- to  ixi.al  s  .,c  "  so  that  certain 

critacion  W  (U)  would  be  ccnvoittu  into  tna  maximum. 

i.et  us  give  to  ccctici  ..ucbojs  geometric  interpretation. 


For 


this  for  us  it  is  necessary  lo  so-iiewnat  widen  our  customary  geometric 
rapra mentations  and  to  int^ouace  *.ue  concept  about  the  so-called 
"phase 
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The  state  of  the  physical  ea  3,  which  we  manage,  always  can 

te  described  with  the  help  Ox  ouu  or  tae  other  quantity  of  numerical 
parameters.  Such  parameters  can  ne,  for  example,  the  coordinates  of 
physical  body  and  its  velocity;  a  ^Uintity  of  means,  included  into 
the  group  of  enterprises;  tu«  nuuiaar  of  grouping  of  the  troops,  etc. 
Thesa  parameters  we  will  cau  cab  ^hise  coordinates  of  system,  and 
the  state  of  system  represent  xx  ue  foe  a  of  point  S’  wita  these 
coorirnates  in  certain  conmtiouax  puase  space.  A  change  of  the  state 
cf  system  s  during  the  central  t.roce»s  will  te  represented  as  the 
displacement  of  point  5  in  ta a  ^nase  space.  The  selection  of  control 
U  indicates  the  selecticn  or  tae  s^e^ific  trajectory  of  point  S  in 
the  paase  space,  the  specizic  iaw  of  motion. 

Phase  space  can  be  aizz«»reat  aeuandiag  on  a  number  of 
parai  aters,  which  characterise  Us  state  of  system. 

».et,  for  example,  the  state  oz  system  S  be  characterized  only  by 
the  one  parameter  -  coctdruata  x.  ihen  a  change  in  this  coordinate 
will  ae  represented  as  tne  u-.spxacc,ne a t  of  point  s  along  the  axis  ox 
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(or  on  its  specific  section,  rr  to  coordinate  x  they  are  superimposed 

are  some  limitations)  .  in  c<xa»  pause  space  will  be 

one-iimensional  and  is  the  axis  ox  auscissas  Cx  or  its  section,  and 

control  is  interpreted  by  cat  j.a«  of  tne  motion  of  point  S  from 

initial  state  S„£S„  into  ixrai  ■''.on  €  S„„,,  (Fig.  6.1). 

If  the  state  of  system  3  ouar  acter  ized  by  two  parameters  x, 

and  x2  (for  example,  the  ans^isaa  of  material  point  and  its 
/alocity)  ,  then  phase  space  aui  oe  plane  xl0x2  or  its  some  part  (if 
to  parameters  xt  and  x2  are  ^  u^or  x«po  sod  limitations),  and  the 
controlled  process  will  ne  r»proS*utai  as  the  displacement  of  point  S 
from  S-,£S- >  in  5knM$\xolt  over  taa  trajectory  cn  plane  x,0x2 

(Fig.  6.2). 


0 


■x 


(•7  06jxcmn  3nj»oj>c^/>/x  coc^mm  cuzmenH 
rpcjodoe  npoimpancmto) 

Fig.  ) «  1* 

Kay:  (1).  Region  of  the  poaa.oie  ^ta tas  of  system  (phase  space). 

Page  42. 

If  the  state  of  system  *s  cnar  art<*rized  ty  three  parameters  xlf 
x2,  Xj  (for  example,  twc  coo..  diaatioS  ana  velocity),  than  phase  space 
will  d€  ordinary  three-dimen.»xoaax  space  or  its  part,  and  the 
controlled  process  will  he  do^ctta  is  the  displacement  of  pcint  S 
ever  space  curve  (Fig.  u.  J)  . 

If  a  number  of  parameters,  wuici  cnaracterize  the  state  cf 
systaa,  is  more  than  three,  «,a<*a  ^oomatrxc  interpretation  loses  its 
graphic  nature,  but  gecmetxiw  t«M.m*n3loy  y  continues  to  remain 
convenient.  In  general,  when  tae  staca  of  system  5  is  described  by  n 
by  the  parameters: 

-Cl-  r2 . A',. 

we  will  represent  it  as  point  j  in  tns  u-ii*ensiona  1  phase  space,  and 
control  interpret  as  the  dis*, iac*m>»nt  of  point  s  frera  some  initial 
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region  S0  into  final  j»b£  cwitatu  ''trajectory",  over  the 

specific  lav. 

In  order  to  make  clear*,.,  a.*  xuea  of  "phase  space",  let  us  return 
to  th a  already  examinee  specific  ^.roolams  which  wa  solved  in  the 
previous  paragraphs,  anc  iat  u*»  construct  for  each  cf  them  phase 
space. 

In  the  task  of  the  optimum  aaj.n  of  altitude  and  velocity  (§3) 
the  state  of  the  physical  j  (flight  vehicle)  was  characterized 

by  two  phase  coordinates  -  vaijer ij  /  ana  with  a  height  of  H. 
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Fig.  o.2. 


Kay:  (1).  aegion  of  the  possaOio  atacas  of  system  {phase  space). 


Fig.  d.3. 


Kay:  (1).  Region  of  the  poss^  ox«»  a.acss  of  system  (phase  space). 


Page  43. 


Respectively  phase  space  was  tw^-u-aa nsim al  and  was  the  phase  plane 
VO H  (more  accurate,  the  recta ltmicid  by  abscissas  Vn.  V'K(m  and 
ordinates  Hn.  f optimum  cuuui.  was  represented  as  the  displacement 
of  pornt  S  over  the  optimum  tCaj«ctocy  on  the  phase  plane.  The 
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initial  state  S0  (V0,  H0)  ana  state  6\,mi d'..,,,,.  Hxnj.  they  were 

completely  determined  ana  we*,  e  points  Sf,.  SKOm  on  the  phase  plane. 

In  the  task  of  the  seo.eotj.cn  of  tne  fastest  path  (§h)  the 
physical  system  s  was  the  true*.  w**-.ca  was  tc  be  translated  frem 
initial  point  S0  into  finao.  SK<M  withm  the  shert  time.  Here  again  the 
state  of  system  was  descrioeu  w/  two  parameters  x  and  y  (ordinary 
Cartesian  plane  coordinates) ,  ana  the  trajectory  of  point  S  cn  the 
phase  plane  was  itself  tne  Co.do.oidr  j  trajectory  of  the  moving/driving 
point  (truck)  . 

The  continuous  tasx  or  oiju.tig  of  optimum  route,  examined  in 
§5,  on  the  setting  and  an  ca®  a.ii,*.si.3u  or  space  differs  in  nc  way 
from  previous.  Let  us  note  t*.at  it  tae  optimum  path  ran  itself  not  in 
the  plane,  but  in  the  space  i tor  «xaiple,  the  path  of  aircraft  of  one 
point/itea  in  another)  ,  then  pnase  space  would  become 
three-dimensional,  but  if  an  t*io.s  case  was  optimized  even  the 
mode/conditions  of  a  change  o.n  cn«  velocity  -  f cur-dimensional. 

In  all,  until  now,  examr iwa  examined  initial  and  final 
conditions  S0  and  were  u«  completely  fixed  points  of  phase 

space.  It  is  not  difficult  to  ^rve  examples  of  the  tasks,  where  these 
states  are  the  whole  regions  s0  aid  5,01l 


of  phase  space 
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Assume,  for  example,  we  netu  to  direct  the  combat  guided  rocket 
from  some  point  S0  cn  the  ea*.ta'±>  surface  into  the  vicinity  cf  target 
Ts  so  that  it  would  stride  tais  target.  It  is  obvious,  for  this  there 
is  no  necessity  tc  direct  rocxak  -uto  che  fixed  point  •<>u  ■  and  it  is 
sufficient  so  that  it  would  ui;  uc  preset  zcre  5u  which  surrounds 
the  target,  sizes/dimensious  and  iurm  of  which  are  determined  by 
damaging  effect  of  rocket.  lue  state  of  rocket  at  each  moment  of  time 
we  will  as  representative  a  in  tna  six-dimensional  phase  space 

(three  coordinates,  three  cospoueuts  of  velocity)  .  At  the  initial 
moment  the  coordinates  cf  iocx«<.  aid  preset;  the  velocity  components 
are  agual  to  zero  (pcint  S0  *.s  co*pljtaly  determined). 

Fage  U4. 

As  far  as  final  state  is  concerned  S„„„.  then  it  is  determined  not 
completely;  space  coordinate^*  must  be  witnin  the  limits  of  the  preset 
zone  5 a.  and  to  the  components  wi  velocity  no  limitations  are 
imposed.  Consequently,  region  5knH  .a  tae  six-dimensional  phase  space 

is  limited  on  coordinates  x,  y,  i  ani  is  unconfined  on  coordinates 

V  .  V  .  V 

Let  us  assume  now  that  u«  discussion  deals  not  with  combat,  but 
about  the  passenger  rccxet;  ior  it  tne  touchdown  point  is  completely 
determined,  but  on  the  velocity  cwmpoasnts  are  superimposed  the 
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severe  limitations;  in  this  cast  region  s,„„  substantially  becomes 
narrow. 

In  the  following  p resent. a >—oii  wa  will  meet  with  a  whole  series 
cf  the  practical  tasks,  wafer.*  tie  initial  state  s’ 0  and  final  .s'.,,,,  are 
not  points,  but  the  whcle  regions  of  pnasa  space. 

Thus,  let  us  formulate  jfeneiar  proalea  of  optimua  control  in  the 
terms  of  phase  space. 

To  find  such  control  U* 
which  point  S  of  phase  space 
finite  domain  5.OM  so  that  in 
maximum. 

Stated  genaral/ccBitca/to  tax  ^roDlnm  can  be  solved  by  different 
methods  -  far  not  only  ty  ta«  m«&nad  or  dynamic  programming. 
Characteristic  for  the  uynaa*.c  j-iogri mming  is  tbe  specific  systematic 

A# 

method,  namely:  the  process  w£  tn«*  displacement  of  point  3  from  S0  in 
■^o,.  is  divided  into  the  seti«*s/*.ow  of  consecutive  stages 
(steps/pitches)  (Fig.  £.4),  ana  i*  pcoduced  the  consecutive 
optimization  of  each  of  tata,  u«g^nning  from  the  latter. 


(oruaui  control),  under  the  effect  of 
wj.x*  aiova  from  the  initial  region  S0  to 
ca*s  casa  criterion  w  will  become 


30C 


80 151503 


E  AG  c. 


Fig .  o. 4  . 

Key:  (1).  step/pitch. 

Page  45. 

In  stage  of  calculation  id  dougat  first  conditional  optimum 

control  (under  all  pcssicle  adductions  aoout  the  results  of  the 
previous  step/pitch),  and  u«a,  aitac  tne  process  of  optimization  is 
led  to  the  initial  state  S0,  agcmu  passes  entire/all  saguancc  of 
steps/pitches,  on  already  i£ui  tu«  beginning  to  the  end/lead,  and  at 
each  step/pitch  from  many  conditional  optimum  controls  is  chosen  one. 

dowever,  what  do  ve  gam  data  tae  ael  p  of  this  step-by-step 
calculation  of  the  process  Oi.  opt^mizawion  ?  We  win  that  the  fact  that 
at  cne  step/pitch  the  structure  u  con;rcl,  as  a  rule,  proves  to  be 
more  simply  than  for  entire  « iongation/extent  of  process.  Instead  of 
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one  time  solving  cf  complex  we  prefer  many  times  to  solve 

problem  relatively  simple. 

In  this  -  entire  ertity  or  u>  tstacl  of  dynamic  programming  and 
entire  justification  fcr  its  use/a^pL ioation  in  practice.  If  this 
simplification  in  the  procauura  uj.  optimization  from  the  distribution 
of  process  into  the  stages  it  auej  not  occur,  tha  use/application  of 
a  metaod  of  dynamic  programming  socoaas  meaningless. 

§7.  3aneral/commcn/tctal  fouuia  ..scorning  of  the  sclution  of  the 
problam  of  optimum  control  ua  mecnod  of  dynamic  programming. 

In  the  previous  parag^a^a  we  rocmulatad  the  gbneral/ccmmcn/total 
formulation  of  the  problem  o.  a^natu ic  programming  and  it  gave  to  this 
task  geometric  interpretatio*.,  oiw«r  posing  it  as  the  problem  of 
steering  cf  point  in  tie  pna.*e  space. 

In  the  present  paragrspa  wo  wxlr  artampt  to  register  in  general 
form  not  only  setting,  tut  uso  s^xucioa  of  the  problem  of  dynamic 
programming.  Are  true,  the  iwcmaxas,  waicn  we  will  obtain,  they  will 
by  necessity  take  the  very  ^ae.aj./cj maon/tctal ,  unspecific  form,  but 
for  tae  understanding  cr  tne  cuu.a  tnase  general  formulas  will  prove 


to  be  useful 
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iefore  to  begin  the  jen,*  ou/total  formula  recording  of 

the  process  of  dynamic  pro*r<* mm*.** ,  we  should  maxe  mote  precise  the 
nature  of  criterion  w,  ntn  m  ru.c**  »e  crnis  far  in  no  way  da-alt. 


Page  46. 

let  us  note  that  in  au  etaidj.ii el,  until  now,  examples  criterion 
y  possessed  one  remarkatle  ^opaity:  taa  value  cf  this  criterion, 
achia ved/reached  for  entire  rroce.*s,  was  obtained  by  the  simple 
addition  cf  the  particular  values  of  tie  same  criterion  of 
achievements  at  the  single  si epa/ritr aas. 


Actually /reall  y ,  c  eneia^/comaion/c otal  fuel  consumption  R  to  the 
gain  of  altitude  and  velocity  §J)  was  the  sum  cf  fuel 

consumption  rl  at  the  singi«  sto^-a/pi.  tcaes : 


'n 


the  total  time  T  of  displacement  «r  j  na  point/item  in  another 


(see 


§4)  was  the  sum  of  the  times  or  overcoming  single  stages 


and  so  on. 


(7.2) 


If  criterion  y  possess**.*  t4**  property: 

w  =  S  «'<•  (7.3) 

I  *  I 

i.e.  it  is  composed  of  tne  «.aiu.or/  values  cf  the  same  criterion. 
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obtained  at  the  single  ste^a/  p-itoues,  cnen  it  is  called  additive. 

In  the  majority  of  the  ^ race *cai.  tasxs,  solved  by  the  method  of 
dynamic  programming,  crateii-n  a  ilaitive.  If  it  in  the  initial 
formulation  of  the  problem  x->  ao.  additive,  then  they  try  then  to 
modify  this  setting  cr  criterion  *  tsa  If  so  that  it  would  gain  the 
property  of  the  additivity  i_.ee  iuitnar,  j1<4). 

ie  will  examine  only  tuo  dau^tivs  tasks  cf  dynamic  programming 
and  some  most  elementary  cne.»  i.uu  taose  leading  to  additive. 

let  us  give  setting  anu  ovtiuxi  diagram  of  the  solution  of  the 
problems  of  dynamic  program  a*  n>j  »*th  tae  additive  criterion. 

Let  there  be  the  ccntroo.  pieces*  of  the  physical  system  S, 
separated  on  m  of  st eps/ pitca es  (stages). 

Page  47. 

At  ouc  disposal  at  each  (i-ta)  *tep/pitch  is  control  by  means  of 
which  we  we  translate  system  of  ut.  state  cf  the  achievement  as 

a  result  (i-1)  step/pitch,  i«to  a»«  state  S,.  which  depends  on 
and  selected  by  us  control  Ur  t uia  dapenaence  we  will  register  as 


follows: 
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Ui)-  (7.4) 

by  considering  S,  as  tho  fun,-  uui  of  two  arguments  and  Ut 

bet  us  note  that  for  taa  method  of  dynamic  programming 

it  is  substantial  so  that  uc  u«i  atiu  would  depend  only  cn  state 
•%-i  and  control  at  i  step/pa.  ecu  O',  inn  it  did  Dot  depand  on  how 
systaa  arrived  into  state  5,_t.  zz  this  proves  tc  be  net  then,  then 
shouli  be  "enriched”  tie  concept  or  tne  "state  cf  system",  after 
introducing  into  it  these  aiflstsrs  froa  the  past,  cn  which  depends 
the  future,  i.e.,  tc  increas*.  a  numbar  ot  measurements  cf  phase 
soaca. 


Jnder  the  effect  cf  centroj-o  Ur  U7 . (J.„  the  system  passes  frem 

the  initial  state  S0  into  n*.ai  ^*o»-  As  a  result  of  entire  process 
after  m  cf  steps/pitches  is  s,ctaj.ued  tae  "  income"  or  "prize" 

'ft 

W  =  2  ®,  (5,_|.  Uj.  {7.5) 

whera  wi(5,_,.  Ut)  -  prize  at  t«e  i  ^teg/pitch,  which  depends, 
naturally,  on  the  previous  ci  system  ■$»- 1  and  selected  ccntrcl 


Is  preset  the  region  ox  taa  initial  states  s0  and  the  final 
states  S<n„  It  is  necessary  wC  ss-i-ecc  initial  state  and 

controls  IjJ.  uj . at  eacu  stwp/pitcft  so  that  after  a  steps/pitches 
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systs  a  would  pass  into  iegio..  i'«„„  aid  in  this  case  prize  W  tecame 
maxim urn. 


Let  us  describe  ic  general  toe  procedure  cf  the 

use/application  of  a  methcu  ui  ijuaiiic  programming  to  the  solution  of 
this  problem. 

For  this  by  us  it  kik  *.6  necessary  to  introduce  seme  new 
designations.  Me  already  designated  *  -  prize  within  always  cf 
process;  t,  -  prize  for  the  i  ster/pitcp.  Since  the  process  of 
dynamic  programming  is  turne^/run  up  from  the  end/lead,  for  us  it  is 
necessary  to  introduce  spac.u.i  ue^igaaricn  for  the  prize,  acquired 
for  several  latter/last  stt^/^tuuej  of  prccess. 

Eage  48. 

i.et  us  designate: 

1  ^  -  prize  for  the  latter/idot  sto^/pitcn, 

'■*  -  prize  foe  two  latter/ last  sts po/pi tches , 

h'.. , .  i,  „  -  prize  for  the  xattex  iw-i*-1)  of  step/pitch,  beginning 

from  the  i-th  and  ending  wit-  tao  w-ch. 


AD-A09B  *06  FOREION  TECHNOLOGY  BIV  BRIGHT -PATTERSON  AFB  OH 
r  ELEMENTS  OF  DYNAMIC  PROGRAMMING.  (U> 

FES  01  T  S  VENTTSEL' 
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It  is  obvious, 

K'™- 1.*  =**•».- 1 +  «’■.■ 

If'/.lil . m  —  +  w"i- 

As  we  already  knew,  Ua  process  or  the  optimization  of  control 
of  thj  method  of  dynaaic  pro3  rujuaung  aegins  frea  the  last  (o-th) 
step/pitch.  Let  afterward  (a- 1> -tu  scep/pitch  tha  system  be  in  state 
•*>*-!•  since  latter/last  (a-tnj  ste^/pitcn  must  translate  system  into 
stata  Sn  —SKm,^Skn„.  ther  as  S„,_,  ±i.  is  possible  to  take  not  all  in  the 
principle  possible  states  or  ij at«a,  but  only  those  from  which  for 
cue  step/pitch  it  is  pcssioia  to  pass  into  region  SKnn. 

Let  us  assume  that  state  to  us  is  known,  and  let  us  find 

under  this  condition  cc r ditic nai  optimum  control  on  ths  m  step/pitch; 
let  us  designate  it  Lf’m(Sm.t).  inx*  is  -  che  control  which,  being  used 
at  tha  a  step/pitch,  translates  systaa  into  final  stata  Sm£Sm„.  the 

prize  at  this  latter/last  st»p/pitch  wn  reaching  its  maximum  value: 

^m(-Sm.i)=  in.ix  \\v,„  U,„)\.  (7.7) 

V 'ft 

Let  us  recall  the  sense  or  sjebjlic  formula  (7.7).  uj 

indicates  prize  generally  (not  optimum)  at  ths  latter/last 
step/pitch;  it  depends  both  on  tne  result  of  previous  step/pitch 
S„_,.  and  on  used  at  this  ste^/pioca  control  U,„.  of  all  gains 
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Un)  during  different  oontroxs  Um  is  chosen  that  prize  W" 

which  has  aaxiaue  value;  this,  it  radicates  recording  max., 

"n 

f  ■  ' 

Page  49. 

Let  us  note  that  as  controls  um  *«  aus;  take  only  thosa  which 
translate  syster  cf  the  preset  auia  5m_,  into  state  belonging  to 
regioa  *^ico*«* 

Finding  the  conditicnai  eaxisua  value  cf  priza  we 

! 

thereby  find  conditicnai  cptmua  control  U'm(Sm.l).  The  fact  that 
conditional  maximum  prize  is  achieved  by  conditional  optimum 

control  (/.($.,. -i).  we  will  cs^-st*..  symbolically  in  the  fcra 

W  m  (Sm.  | ) — ■  (Jm  (Sm-  I  ) 

and  subsequently  we  will  use  recording  fcr  the  indication  of 

conformity  between  the  ccnui»ion«A  uxiiui  prize  and  the  conditional 
optiaun  control  at  each  ste^/pitcn. 

Thus,  the  optiiizaticn  or  iattec/last  step/pitch  with  any  result 
of  naxt-to-last  is  produced,  ana  is  found  the  corresponding 
conditional  optiaua  control.  Iu%  outlined  result  can  ha  formulated 
thus:  in  whatever  state  proved  to  ue  tne  systea  after  (a-1) 
step/pitch,  we  already  know  mat  .o  as  to  make  further. 


.v-  -■ 
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Let  us  switch  over  to  ua  u^uaizauon  of  naxt-to-last  (m-1) 
step/pitch.  Let  us  do  again  ku  aaauip;io&  that  as  a  result  ( ■—  2 ) 
step/ pitch  the  systee  arriveu  ijau  state  $*_ Let  at  (a-1)'  step/pitch 

we  use  control  Um.v  as  a  iwiu  or  cars  control  we  at  (n-1) 
3tep/pitch  will  obtain  tne  p*.  n»,  whica  depends  both  cn  the  state  of 
systea  and  on  the  used  control; 

®*“l  ~  I  U  m  ~\) '  If. 8) 

and  systea  becones  new  state  Sm-r  also  depending  on  the  previous 
state  and  on  the  centre  1: 

~  U 1).  (7  1) 

iut  for  any  result  or  * tap /pitch  the  following,  ■ 

step/pitch  is  already  cptia-weu,  <*nd  naxiaun  prize  cn  it  is  equal  to 

'P„(.Sw_i)=  (S«-2-  (/*_ i ) )  •).  (7.10) 

FOOTNOTE  ».  The  sense  cl  recuraiu*  (/.IQ)  following;  prize  '.r*  there 
is  a  function  of  state  5„_(,  ■  ha.cn  in  tarn,  depends  cn  previous  state 

s«->  and  used  control  Um.x.  b*nce  tor  tne  designation  cf  functional 
dependence  it  is  accepted  to  uoe  cue  parenthesis,  then  in  the 
foranlas  cf  type  (7.10)  we  p^ac*  .ue  parenthesis  of  inside  circular 
Ones.  1NDPCCTR0TE. 

Page  50. 


Let  us  introduce  into  we  •xaiiaacion  f ull/total/ccnplete  prize 
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at  two  latter/last  steps/pitohes  curing  any  control  at  (a-1) 
step/pitch  optiaua  cent  col  a*,  to*  m  *  tip/pitch.  Let  as  designate  its 
iy«-i. «;  sign  it  will  us  reama  that  this  is  prize  during  the 
incoapletely  optimized  central,  esnerast  tc  tha  sign  ty  which 

we  designated  prize  with  tnat  ccw»*-».ec  aly  optixized  control.  Prize 
it  is  obvious,  it  aer*j*us  on  tua  previous  state  of  systea 
5m_j  and  used  at  (a-1)  step/fit ca  control  ^m-v  Taking  into  account 
foraulas  (7.8)  and  (7. 1C),  w «*  wn jl  ootain  the  following  expression 
for  UTS-,.,: 

m- I,  n$  (Sm-i-  Um-\)  = 

=  Um- 1)  — (Sm-i(Sm-J.  (/«_])).  (7.11) 

we  should  select  this  optiaua  conditional  control  at  (a- 1) 
step/pitch  (/*-, (S*_2).  with  wa^cn  Vaw.ua  (7.11)  would  achieve  the 
aaxiaua: 

'•  m  —  rnax  |)}.  (7.12) 

/*-  i 

Just  as  in  the  previous  stage  of  opti  aization,  as  states  Sm.i 
afterward  (a-2)  steps/pitcae*  necessary  tc  take  net  all 

possible  states  of  systea,  out  eew./  chose  froa  which  it  is  possible 
to  pass  in  for  two  steps/  pi  tones. 

Thus,  is  found  aaxiaua  conditional  prize  on  twe  latter/last 
steps/pitches  and  corresponding  to  it  optiaua  conditional  control  at 
(a-1)  step/pitch: 
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ay  continuing  by  accu£cu.4xj  auca  form,  it  is  possible  tc  find 
conditional  maximum  prizes  u  several  xatter/last  steps/pitches  of 
process  and  correspondicg  to  t optimum  conditional  controls: 

«l-l.  Ml  (S/n-s)  y m -7  (Swi-j). 

-3.  flt-i,  "»-l.  »  (•$>*  --t)~  Um-iiSn-i) 

and  so  forth. 


Page  51. 


If  we  already  optiiuzau  U  +  lj  scap/pitch  for  any  issue  of  the 
i-th,  i.e.,  they  foucd 

+  • <»  (5,)  ~  £/,  +  i  (5<). 

that  tha  conditional  optimization  of  t ae  *  stc p/pitch  it  is  produced 
according  to  the  general  forauxe 

. max  (*£,„. . Ut)\.  (7.13) 

where 


U,)  = 

=  W,)-f  «7*+, . W(S,(S,.,.  I/,))  (7.U) 

-  prize,  reached  at  the  latter/ xast  at ops/pitches,  beginning  from  the 
i-th,  during  any  control  an  u«  *  ate  p/pitch  and  optimum  control  on 
all  those  following;  .u,)  -  stare  into  which  passes  the 

system  from  si-i  under  the  ax  tact  of  control  (/<. 


Thus,  is  deteriined  cuhui;.OMal  maximum  prize  at  the  last 
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steps/pitches,  beginning  fro*  Cite  *-th#  and  the  corresponding  optiaua 
conditional  ccntrcl  at  the  i  star/ritch: 

m(Sl-i)~u'(si-o.  (7.15) 

Applying  consecutl vel^/oar^o^xy,  step  by  step,  t ha  described 
procedure,  we  will  react  LiwU/  cue  first  step/pitch: 

wt *  (So)  —  U’i  (So).  (7.16) 

<^a 

whera  S„  -  soae  initial  star*  jt  assess,  which  belongs  to  region  SQ 
of  tha  possible  initial  stacks:  S0 £S0. 


Seaains  to  select  cptiaalxj  cue  initial  state  of  systea  S*„.  if 
the  initial  state  s0  in  tae  accuracy  preset  (i.e.  entire/all  region 
sf0  is  reduced  to  one  pcint  S„)  ,  ca« n  taare  is  no  selection,  and 
3*0=S j.  But  if  point  S o  can  tc eeiy  oa  chosen  in  the  liaits  of  region 
S0,  taen  it  is  necessary  to  optiaise  tae  selection  of  initial  state, 
i.e.,  to  find  absolute  (no  lunger  conditional)  aaxiaua  prize  in  all 
steps/pitches: 


"'a*  «...., 

j.ei; 


(S«>). 


(7.17) 


where  the  recording  max  inuicacee:  aaxiaua  is  tahen  due  to  all 

$e€ 

states  S0 ,  entering  regicn  su.  *oiut  S*0,  at  which  it  is  reached  this 
aaxiaua,  and  should  be  taken  as  cn«  initial  state  of  systea. 


Page  52. 


rhus,  as  a  result  cf  cn*  consecutive  passage  of  all  stages  froa 
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the  sad/lead  at  the  beginning  ai»  round:  the  taximum  value  of  prize 
for  all  a  steps/pitches  ana  eo**wsf0naing  tc  it  optimum  initial  state 
cf  tha  process 

\v'  =•»•;.; . (7  18). 

3ut  is  constructed  already  ur.imj  control?  Nc  yet:  indeed  we 
found  on  each  step/pitch  cali  .n  conditional  cptiaue  control. 

In  order  to  find  optimum  control  in  c h 3  final  instance,  we  aust 
again  pass  entire  sequence  o.  ste^s/p itches  -  this  tiaa  from  the 
beginning  toward  the  enc.  la^s  second  "passage  cn  the  steps/pitches" 
will  ae  much  simpler  than  ca«  rirso,  because  to  vary  conditions  no 
longer  it  is  necessary. 

As  the  initial  state  or  sjazmrn  is  selected  S*0  (cr  simply  sor  if 
initial  state  is  rigidly  fixod/iecorded)  .  At  the  first  step/pitch  is 
applied  the  optiaua  control  u * 1  t»«*e  (7.16)) 

t/’=  4/7(5^).  (7.19) 

after  which  systea  it  passes  into  newly  the  state 

=  Si  (So.  u7).  (7.20) 

It  is  now  necessary  tc  seise*  ortiaua  control  at  the  second 
step/pitch.  He  already  cptim.zea  1*  for  any  result  cf  the  first 
step/pitch,  i.e.  we  knew  i*»aa  (7.15));  substituting  in  it 

S*t«  ae  will  obtain 

(7.2D 


DOC  »  80151503 


FACE 


and  so  on,  until  we  reach  xnw  o^t-taua  control  at  the  latter/last 
step/pitch 

Um  —  U'„{s',n- l)  (7.22)  - 

and  tae  final  states  cf  the  &>  yaiea 

Stn  =  Sm  (Sfn  -  i .  U ,).  (7.23) 

As  a  result  of  this  wi.uu  *.x wcaiar*  is  found  finally  the 
solution  cf  the  problec:  possible  prize  H *  and  the  cptiaua 

control  U*  which  consists  ox  taw  ortioua  controls  on  the  single 
steps/pitches  (vector  cf  opt^aaa  control) 

u’  =  (u\.  U*1 . U*m).  (7.24) 

Page  53. 

Thus,  in  the  process  or  d/uaeaC  pcograaning  the  sequence  of 
stages  passes  twice:  fee  turn  fjxwt  tie*  -  fzca  the  end/lead  at  the 
beginning,  as  a  result  cf  «o*ca  x*  found  the  aaxiaua  value  cf  prize 
<1*,  the  optiaua  initial  star*  ox  *x ocess  S*0  and  conditional  cptiaua 
control  at  each  step/pitch;  roc  uw  second  tiie  -  froa  the  beginning 
toward  the  end,  as  a  result  wf  wuxoh  is  found  optiaua  control  U*  on 
each  step/pitch  and  final  state  ox  systea  with  the  cptiaua  control  5«ni(. 


Thus,  we  succeeded  in  pfcewwnt*nj  xn  general  fora  and  registering 
with  the  help  of  the  generax  foxau^as  che  process  of  dynaaic 
prograaaing.  In  view  of  the  wyaoox^c  recording  cf  fcraulas  the 
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structure  of  process  is  very  sim fn,  oat  this  -  false  iapression. 

Upon  the  setting  of  the  spamfxc  paoolems  of  dynamic  programming 
frequently  appear  the  difficulties. 

These  difficulties  are  connected,  in  the  first  place,  with  the 
selection  of  the  group  ct  pa*.  am«te*.s  xt ,  x2,  . ..,  x„.  characterizing 
the  state  of  the  physical  syae**  a.  As  it  was  already  said,  these 

parameters  nust  be  chosen  so  taat  in  tie  preset  state  -S (jt,.  x2 . x„)  of 

system  3  at  any  mcment/tot^u«  it*  roiiowiag  state  s'{x'r  *\ . *').  into 

which  it  passes  under  the  efreot  or  coutrol  U,  it  depended  only  on 
the  previous  state  s  and  cta*.rs*.  U  aad  did  not  depend  on  "past 
history"  of  process,  i.e.,  ucm  mat,  when,  as  as  a  result  of  what 
controls  system  arrived  into  stats  S.  If  this  proves  to  be  not  then 
it  comes  those  element s/ceii*  or  me  past  on  which  depends  the 
future,  tc  include  in  the  set  or  parameters  xr  xv  —  x„.  those 
characterizing  the  state  ct  j»yst«m  at  the  given  moment/tergue.  But 
this  leads  to  an  increase  x*  tae  number  of  measurements  of  phase 
space  and,  which  means,  to  me  complication  cf  task. 

The  second  difficulty  consists  of  reasonable  "staging"  cf 
process.  It  is  necessary  so  ic  uisaagage  the  process  cf  transition 
froe  30  tc  Stm  to  the  steps/*. atone*  so  that  they  would  allow/assume 
the  convenient  numbering  auu  cam  precise  sequence  of  operations.  This 
task  is  frequently  far  rot  s*.apa*« 
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Page  34. 

As  has  been  mentioned  nov*,  tha  distribution  cf  process  into 
the  discrete/digital  "steps/r i*.cuo»"  is  not  the  nacessary  < 

sign/criterion  of  the  tethod  cr  aj Mamie  programming.  In  principle 
always  it  is  possible  tc  direct  ta»  length  of  step/pitch  toward  zero 
and  to  consider  limiting  Cas»  -  "conciauous"  dynaaic  programming.  It 
is  possible  tc  obtain  in  tne  Lmi  fora  the  solution  of  such 
continuous  problems  crly  in  the  rare  cases,  but  they  have  the  high 
theoretical  value  in  the  proof  ur  oha  existence  theorems,  and  also 
different  qualitative  picp«mes  or  tha  optimum  solutions  (see  [  1  ])  . 

In  our  elementary  presentation  or  tha  aetnod  cf  dynamic  programming 
we  will  in  no  way  concern  tu*se  limiting  cases. 

In  further  paragraphs  wo  win  consider  a  whole  series  of  the 
practical  tasks,  which  are  aus*uat«/approach  under  the  overall 
diagram  of  dynaaic  programming,  home  of  these  tasks  we  will  only 
supply,  for  the  majority  let  us  saetsh  the  diagram  of  the  solution, 
while  some  solution  tc  the  wnd/ieau*  Some  tasks  comparatively  easily 
are  carried  out  under  the  ov«ran  diagram,  presented  in  this 
paragraph;  above  the  setting  or  otner3  it  is  necessary  to  still  take 
some  pains  itself.  Keeping  in  ana  uawieldiness  of  calculations  "by 
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hand",  it  is  easy  to  ccmpre a«nu  Luat  to  the  ccncrete/specif ic/actaal 
numerical  result  will  he  lea  uxi  cha  Simplest  tasks  with  a  small 
number  of  parameters  x,,  x2,  ...»  that  ara  determining  the  state  of 
system.  However,  it  is  cecs&aarj  u.  nave  xn  mind  that  by  completely 
the  same  methods  with  the  iau.r  cx  tna  contemporary  high  speed 
computers  it  is  possible  to  -cav*  ani  much  more  complex  problems  with 
a  considerable  number  cf  p However,  as  far  as  number  is 
concerned  of  steps/pitches  a,  than  for  the  machine  calculation  its 
increase  difficulties  dees  not  generally  obtain:  simply  increases  the 
time  of  calculation  pro pcrtxonaj.  «,u  a  number  cf  steps/pitches. 

Page  55. 

§3.  Task  cf  distributing  t a*  Cssoux cas/lif eti tes. 

Among  the  practical  tas*s,  sox vs d  by  the  method  of  dynamic 
programming,  many  they  have  os  a  acax  ao  find  the  rational 
distribution  cf  resources/xxx etxs«s  according  to  different  categories 
of  actions.  To  this  type  belongs,  roc  example,  the  task  about  the 
distribution  cf  means  tc  us  a*uxr seat,  the  purchase  of  raw  material 
and  tae  hire  cf  work  feica  auU^  the  organizaticn  for  work  cf 
industrial  enterprise;  the  uu  awouc.  tae  distribution  cf  goeds 
according  to  the  commerciax  anu  sswraga  locations;  the  task  about  the 
distribution  of  means  betw«*u  axrisraac  branches  of  industry;  the 
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task  about  the  weight  distributee*.  ba tween  different  aggregates/units 
of  technical  da  vice/equip nest  ,  «tc. 

dere  we  will  consider  ua  or  tha  simplest  tasks  of  distributing 
the  r asources/lifetimes,  cn  aaron  it  is  easy  tc  demonstrate  the 
special  feature/peculiarity  of  mam;  similar  tasks. 

There  is  preset  initial  quantity  of  leans  Z0  (it  is  not 
compulsory  in  the  mcney  term*  ,  waich  we  must  distribute  between  two 
brancaes  of  the  production;  1  ana  11.  These  means,  being  they  are 
imbedied  in  branch  I  and  L*.,  yx «ia  tne  specific  income.  A  quantity  cf 
means  x,  included  into  franc*.  1,  m  one  year  arrives  income  f  (x)  ;  in 
this  case  it  is  reduced  (par*,  laai/  it  is  expended),  sc  that  toward 
the  and  of  the  year  from  it  * iioius  the  ramainder/residue,  equal  to 

Is  analogous  a  quantity  cf  saans  y,  imoedaed  in  branch  II,  yields  in 
the  year  income  g(y)  and  is  *<auct.u  to  My)-' 

My)<y. 

After  each  year  the  remains*  aaans  again  are  distributed 
between  the  branches.  New  bmas  n  dies  not  act,  and  into  the 
production  are  packed  all  remaining  in  the  presence  meats. 

It  is  necessary  tc  finu  saca  method  of  ccntrol  of  service  lives 
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-  whit  xeans,  in  what  years  aou  luto  wait  tranches  to  pack,  with 
which  total  income  during  cju  ^aiucd  iate  ■  of  years  is  converted 
into  the  maximum. 

4e  will  solve  problem  oi  u«  mecaod  of  dynamic  programming.  The 
physical  system  sr  which  wa  ■  in  manage,  is  the  group  of  enterprises 
with  the  imbedded  in  them  means.  tuize  a  -  inccme  hrco  both  tranches 
I  and  II  during  entire  penou.  Atuagi  sent  -  tc  plan/glide  cn  a  of 
years  -  gives  the  natnral  articulation  of  process  on  m  cf 
steps/pitches  (stages).  Howavar,  iw r  taa  purpose  of  prasentation  we 
will  at  each  step/pitch  distinguish  two  halfsteps  or 
"component/link".  On  the  first  or  them  occurs  the  redistribution  of 
means;  on  the  second  -  tne  a*d ns  ct.ly  are  expended  and  cccurs 
formation  of  inccme. 

Page  56. 

i.et  us  select  the  now  numerical  parameters  with  the  help  of 
which  we  will  characterize  ^tuauoa  (state  of  system). 

The  situation  before  oe^infiiu^  the  i  stage  (before  the 
redistribution  of  means)  let  us  a^iea  to  characterize  by  quantities 
cf  tha  means 
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those  regaining  in  brarcnes  ▲  ana  al  after  previous  (i- 1) 
step/pitch*. 

FOOTM JTB  *.  This  does  net  rebate  ctu  rirst  step/pitch  in  the 
baginning  of  which  to  os  is  qivan  certain  quantity  of  neans 

Z„.  ENDPOCTNOTE. 

Situation  after  the  distribution  or  leans  (i. e.  after  the  first 
compoaent/link  of  the  i  step/pitcuj  we  will  characterize  by 
quantities  of  the  means 

*£•  yf. 

those  packed  in  branch  X  ana  IX  a*.  tnis  step/pitch. 

As  a  result  of  the  secouU  coa^oa ant/lisk  of  the  i  stap/pitch 
(consumption  of  resources)  tnes*  values  it  is  reduced  and  will  become 
equal  to 

x ..  y\ 

after  which  we  let  us  pass  to  tae  lolluwing  step/pitch. 

net  us  depict  the  state  or  a^staa  as  point  S  in  the  phase  space. 
This  space  can  be  corstzucteu  in  aifferent  ways;  for  the  purpese  of 
clarity  we  will  select  its  t*o-aiaensional  (Fig.  8.  1)  . 

Along  the  axis  of  absniosas  us  we  will  plot/deposit  the  quantity 
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of  rssources,  packad  ictc  tuaju  ±;  ;n  axis  of  ordinates  oy  - 
quantity  cf  resources,  pacxeu  branch  II.  Then  phase  space  will 

be  the  part  of  plane  xCj,  wa^ca  a^s  within  a  r.d  on  the  borders  of 
triangle  AOB.  Actual  1  y/ieaxi^  ,  z<j*.  any  stags  cf  production  the  sun  of 
the  resources,  imbedded  in  du<-n  i  ini  II,  cannot  exceed  the  initial 
supply  of  the  resources: 

*-Kv>4;  (8.1) 

furthermore,  these  enclcsurea  a*«  non-negative: 

•*>0;  y>0.  (8.2, 
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Fig.  3.1. 


Page  57. 

By  tha  region  of  plane  *oy,  maj.nu  satisfies  conditions  (8.  1)  and 
(3.2),  is  triangle  Ace;  this  auu  mere  is  the  phase  space,  in  which 
it  can  change  its  position  point  a,  which  represents  the  state  of 
systea. 

Let  us  deteraine  region*  ?0  »*»d  of  the  initial  and  final 
conditions  of  systea. 


At  the  initial  acaent  s*ags«,  that  we  knew  atcut  the  state  of 
systea,  this  that  the  fact  tuat  cue  jub  cf  enclcsures  into  both 
branches  is  equal  to  the  ins*!**  supply  of  the  resources: 

x  4-  y  = 
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This  condition  satisfies  au /  po—u*.  cutting  off  A3,  which  and  is 
rsqioa  S0  of  the  initial  starts  ox  sysiea.  As  far  as  position  is 
concerned  of  end  point  Sntm.  caeu  we  *a>w  only  that  foe  it 

x>°-  y  >  0.  X  +  y  <  zv 

i.e.  region  S.ou  is  entire  ir«.an3x«  AJ3,  besides  hypetsnuse  AB. 

Let  us  look,  what  tern  u an  taxe  tne  trajectory  of  point  S  in  the 
phase  space,  since  we  exaa^e*  a-xscxecited  prohlea,  this  trajectory  we 
will  represent  in  the  fera  cx  txoxen  ixne  (Pig.  8.2).  At  the  first 
step/ pitch,  in  contrast  to  others,  occurs  cnly  the  expenditure  of  the 
resources  (there  is  nc  t«<us.ciui.xOa).  ~Xa  this  case  cf  the  point  s0 
with  the  coordinates  (x,,  j  rass  xnto  point  n  with  the 

coordinates  (x*,,  y',).  Sinc«  xliext,  y'^y,,  the  this  coapcnent/link 
of  trajectory  is  the  secaent,  a^iwctad  froa  pcint  S0  downward  and  to 
the  left.  The  following  (swcxauj  ..tep/pitch  is  divided  into  two 
conponents/links:  2t  ana  .  an  u«  first  coaponent/link  2t  occurs 
the  redistribution  of  resources;  .a  this  case  x*y  reaains  constant 
and,  which  aeans,  point  s  is  aorta  oa  tne  straight  line,  parallel  AB, 
into  point  N  with  the  ccoraiMdtss  ix2,  y*)  .  on  the  second 
conpoaent/link  of  second  ster/*itca  (2*)  again  occurs  the  expenditure 
cf  resources,  and  point  s  aoves  uownward  and  to  the  left,  and  so  on, 
until  through  a  cf  steps/ piu.a*s  x*  acnxewed/reached  final  state 
S,..„  -  point  with  coordinate*  y'ny 


f  Adt  /&f 


f 
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Let  us  not*  that  tne  com^jukais/Uuns  c£  staps/pitches  are 
nonequivalent :  contccl  is  realrreu  only  cn  the  first  coeponent/link 
cf  each  step/pitch,  and  cn  ts«  second  obtain  laccae.  Contccl  Ut  cn 
the  1  step/pitch  (realized  o*  cum  tl: a;  coapcnenr/link  i()  consists 
cf  the  selection  cf  ncr-ne^aterv*  values  x,.  y,  of  such,  that 

x/+.v(  = 

After  this  we  obtain  oc  tae  aacoau  component/ linn  of  the  i  step/pitch 
(I2)  the  inccee 

•<  —  /(*,)  + (8.3) 

but  point  S,  which  represents  cm  etat*  of  systee,  passes  to  the  new 
position  with  the  coordinates 

•r v,'  =  l-(y().  ,8.4) 

It  is  necessary  tc  find  tax*  position  S*0  of  point  S0  on  the 
strai|ht  line  AB  and  this  trajectory  of  point  S  in  the  phase  space  so 
that  the  total  incoae  fcr  ai.  a  or  tae  steps/pitches 

"t 

\V  —  v 

,r,  '  (8-5) 

would  be  converted  into  tn«  viutai. 
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Fig.  3.2. 

Page  59. 

Jefoce  us  -  the  typxcax  ta-x  of  dyuaaic  programing.  let  us  use 
to  its  solution  the  gererax/cca«c*»/t3tai  aethcds,  presented  in  the 
previous  paragraph.  In  crder  to  aaae  a  coacrete/specific/actual 
application/appendix  of  geua*.  ax  aethod  as  clear  as  possible,  we  will 
peraic  ourselves  perhaps  a  x-ttxe  to  be  repeated. 

As  always,  we  will  cptxaia*  *.ae  process  cf  distributing  the 
resources,  beginning  frci  ta«  euu/xead,  aoreover  iaiediately  cn  both 
coaponents/links  of  each  st*r/fXton  (taxing  intc  account  that  the 
second  of  the*  it  is  urguiuau). 
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<.et  before  the  a-th  (xdwtdi^ast)  step/pitca  we  be  found  at 
point  (■**_,.  y*.i)»  and  we  a  use  resources,  i.e.,  select 

point  (xm.  ym)  such,  that 

Let  us  note  that  fcr  scj-viu*  this  cor  us  is  not  required 
knowledge  of  both  nuabers  y»_r  and  it  is  essential  to  knew  only 

their  sun,  which  is  subject  „c  t am  redistribution: 

Z  s  x‘  .  4-  u'  l\ 

m  -l  m-l  ~  ym-\  >• 

FOOTNOTE  *.  Since  the  state  wf  sisten  liter  each  stage  is 
characterized  only  by  cow  nu«oer,  we  could  select  our  phase  space 
cne-iiaensional,  but  then  tr*>ctoty  would  appear  sc  not  clearly. 

END FOOTNOTE. 

tie  distribution  will  consist  *0  the  iact  that  we  will  isolate 
sone  part  <m  cf  resources  Zm_,  *«.&  put  it  into  branch  I;  a  quantity 
cf  resources  y„.  which  is  pac*ea  i«to  orunch  II,  autcaat ically  it  will 
be  deterained  fron  the  zclat^caaa^p/ratic 

=  —  Xm. 

Thus,  at  n  step/pitch  "ccaoiwi"  is  *m  ae  aust  tied  on  this 
step/pitch  conditional  cptiaaa  control,  i.e.,  for  any  value  £*-t  find 
such  quantity  of  resources  **m(Zm_,).  of  mose  packed  in  branch  I,  with 
which  the  inccae  at  the  a  st«p/r*tch,  equal  tc 

Xm)  —  Wm(Z, AT,,). 


18. (3) 
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is  couvsrtsd  into  th«  nuiiu: 


l P’.CZ,..,)-.  max  x.)|.  (8.7) 


I 
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Page  60. 

according  max.  Beans  toat  as  tax  aa  tae  maximum 

in  terns  of  all  possible  at  tuxs  .»tep  values  cf  control  -<V-  they  are 
non-nigative  and  do  not  exceed  ta«  ganecal/cc xmcn/t ctal  supply  of 
naans  lm-\'  by  which  we  arrived  at  this  step. 

dxpressing  maximux  inco* a  to.  7)  at  tne  last  step/pitch  through 
the  imbedded  means  accciaxLy  to  xuxnuxa  (3.3),  we  will  obtain 

[Z.n.  i)=  max  \f  {xn)-\-g{Zm.{  —  .vj|.(8.3) 

ro  this  maximum  value  cw cxes^unis  the  specific  conditional 
optimum  control  at  the  s  step/^xtca 

Vm{zm.  i)  —  C/;„ 

and  tne  problem  of  the  ccoai.ittd.  optimization  of  the  m  step/pitch 
is  solved. 

let  us  switch  over  to  t*e  conditional  cptiiizaticn  of 
next-to-last  ((m-l)-th  st«^/rucu.  La  t  after  (m-2)-th  step/pitch  be 
preserved  the  supply  of  the  »eans 

^■n-2  ~Xm-2~^~  ^ m-T 


(3.9) 
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Let  ui  find  ,,  (Z„,_;)  -  uwaa^c^nal  maximum  income  in  tuc 

lattsr/last  steps/pitches.  L«t  central  used  at  (m-l)-th 

step/pitch,  consist  cf  the  uct  cast  *a  pack  into  branch  I  previsions 
(and  that  means,  ictc  rl  -  provisions  —  Z,„_:  — 

w it h  respect  to  these  enclosures  at  (m-l)-th  step/pitch  we  will 
obtain  the  inccne 

Mm-l'  -0~f  (**- 1)  +  ZlZm-l  —  *„-!>•  18.IO) 

and  system  changes  intc  the  ,oim.  cf  phase  space  with  the  coordinates 

According  to  the  genera-. /ccuiaoa/totaJ.  principle  (see  §7)  in 
order  to  optimize  condition*-.  cca*.-.cl  at  (m-l)-th  step/pitch,  it  is 
necessary  to  sum  inccme  at  (u-l)~cc  stap/pitch  (8.10)  during  any 
control  i  with  the  alxaau^  o*.t-.iuize.u  mccme  at  m  step/pitch  (8.8); 
we  will  obtain  total  inccas  *t  two  lattar/last  steps/pitches 

^ tit  -  '/t  rn-7 •  -f,»-l)  = 

—  K7,._  |  (Z,.  _  2,  Xm.  |)  -}-  W  m  (Z,n-l  )•  (S.I2) 


Page  61. 

After  this  let  us  frnu  the  ccntrol  xm_,  cn  (a-l)-th  step/pitch 
with  which  inccne  (8.12)  is  converter  into  the  maximum: 

'^*-1,  m  (?-m  -j)  — 

=  max  x,n  _ i)| •  (8.13) 

<zm.. 
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Lat  iii  write  evident  express-ca  ^i-i. ,m(Z,n_:.  as  to  function  from 

both  arguments.  For  this  let  us  .aansticata  into  formula  (8.12) 
expression  (8.10): 

1,  m  (Z*- ?•  •*«—  l)  == 

—  )~\~g(Zm.j.  — (8.14) 

Eut  oa  right  side  of  (8.14)  *s  liicxudeu,  besides  Zm_7  and  still 

Zn_v  in  order  to  get  rid  or  “•xoess"  argument,  let  us  recall 

that  the  supply  of  means  Zm. t  art**.  (m-l)-th  step/pitch  depends  on 
the  supply  of  means  Z„_j.  ci  a  va-nanle  at  the  beginning  of  this 
step/pitch,  and  used  at  (m-l^-tu  otap/pitch  control  xm- 1;  according  to 
formula  (8.4) 

Zn-l  —  ?(-*„_  +  —  xm-0-  (8.15) 

Substituting  this  expression  into  rormula  (8.14)  and  then  (8.14)  in 
(8.13),  we  will  obtain  finally  ta«  expression  of  conditional  maximum 
income  at  two  lattec/last  st« ps/^^tcnes: 

^  -n  —  I ,  m  (  Z,n  -  2 )  — 

=  '"ax  {/(xw_,)-r-)r(^m.2— 

1  *"  rm-  l  **  -  1 

-+-  WC  (?(-*»,-  |)4-  'j(Z,n-l  —  *„_)))  j.  (8  Iti) 

whera  f,  g,  *  -  specific,  pr*s.t  functions  cf  their  arguments,  and 

(Z,._  i)  -  function,  obtaiceu  as  a  result  of  the  conditional 
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optimization  of  latter/last  ^ a;  into  this  function  (given  cne 
by  formula,  graph  or  tables  -.asteau  of  arguiect  it  is  necessary 

to  suostitute  value  (8.15). 


Page  62. 


The  value  with  uaiwn  attains  aaxiaua  (3.16).  and  there  is 

conditional  optimum  ccntrcx  at  im-1)-tn  step/pitch 

*;.,(*-*)• 

Thus,  the  problem  cf  tna  ccuartional  optimizaticn  cf  control  at 
(m-l)-th  step/pitch  is  selvae  to  round  conditional  maximum  income  in 
two  latter/last  steps/pitcaeo  auu  corresponding  to  it  conditional 
optimum  controls  -  quantity  at  loaaS,  pacxed  cn  (m-l)-th  step/pitch 
into  oranch  I: 


w 


/«-!.  m  Xm-\ 


iy  continuing  the  prcce^s  or  conditional  optimization  in  exactly 
the  same  manner,  we  will  cutain  tor  any  (the  i-th)  step/pitch 
conditional  maximum  income  twr  art  sc aps/pitches,  by  beginning  from 
the  data: 

lV,i,  i  I  I,  I''*  - •) 

=.  max  (U7;*j  +  i tn(Zi- !•■*«)}•  (8.17) 


where 


wr..  +  , . m(Zi- 1.  Jf.)  —/(xi)+ir{Zi.i-—xl)  + 

-+-  ....  «(?(■*<) -+- '}rizi- 1  —  •*,))•  (8. 1 8) 
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and  '.v "  i  -  functicr,  ai^adU;  constructed  during  the  optinizat  ion 

of  the  i  step/pitch;  into  i.^ctioa  instead  of  argument  7->  it  is 

necessary  to  substitute  the  expression 

?  ( -'•-/)+  •?(£,_ ,  -  .t,).  (8.19) 

Substituting  (8.18)  in  (fc.17*  ,  *o  »iii  ootain  evident  expression 
•r*  through  Jiccun  iu.uctu.oas  /•  g-  ?•'!*•  U’,\, 

u'-. .  .  i . ,»tZr- 1)—  max  l/(*,)-hg(Zl-l  —  ■*,)  4- 

"<x, 

T^ihi...  (-cii  4-  i>  (^i-i  —  ■<>) )  !•  (.8.20) 

To  this  conditional  maximum  tuccwe  corresponds  conditional  optimum 
control  at  the  i  step/citcni 

K,n . (*,-, )-•<(*!-.)•  l82l) 

When  thus  we  produce  tiie  ccuuitioaal  optimization  of  all 
steps/pitches,  except  the  :i.a.  ^«t  us  recall  that  it  is 
qualitatively  different  from  cue  ethers,  since  it  consists  cnly  of 
cne  component/link) ,  tc  us  it  rema-ns  to  optimize  control  on  this 
first  step/pitch  and  tc  fiuu  ta«  maximum  f ull/tctal/ccmplete  prize  at 
all  sceps/pitches,  which  dep«nus  goes  withcut  saying  on  the 
initial  supply  of  means  Z0; 

r*(20)  =  r;,j . „  (Zo).  (8  22)  . 
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/alue  U"ii2 . «,(/,■)  will  lucatad  from  the  saute  formula  (8.20)  as 

at  tha  remaining  ste  ps/p itcn*.  s; 

W'.i . m(Zo)—  max  (/(jc,)-}-.?(Z0  —  *,)  + 

0<.i,  <2, 

4-^'j . »(?(-«,)  + 1  (A  —  •*,))}.  (8.23) 

Entire/all  special  f€ature/p«scaxxat.it  /  or  the  first,  stap/pitch  lies 
ia  th  i  fact  that  the  iritiax  sdtt.±j  of  means  Z0  is  rot  varied,  but  it 
is  assumed  to  be  known.  Thu  va-tus  uf  control  x*t,  at  which  reaches 
maximum  (8.23),  is  nc  lcngoi  coru..«.io  nal  iy  optimum,  but  simply 
optimum  control  at  the  first  sz*t/ titca  wuich  it  is  necessary  to  use. 

This  value  x* t  determines  tn«  aoscissa  c£  point  S*0  cn  cutting 
cff  A J,  with  which  begirs  optimum  trajectory  in  the  phase  space. 

knowing  the  position  or  tnii,  toiaz  and  again  passing  all 
steps/pitches,  but  already  tn«*  opposite  direction  -  from  the 
beginning  toward  the  end,  it  is  roasii}i.d  to  construct  antire  optimum 
trajectory  of  point  S.  let  ua  trace  now  will  pass  this  trajectory,  on 
the  steps/pitches  and  their  ccm^oueats/iinks. 


in  the  beginning  cf  tne  Uw.  step/pitch  point  S  is  found  on 
cutting  cff  AS  and  has  ccoru.uac«s 


After  the  first  step/pitch  p^An«. 
coordinates  , 


o  is  moved  into  tae  point  with  the 

(y\f  =  ■!'(>’’)• 
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sun  or  which  is  equal  tc  tae  of  means  after  the  first 

step/pitch 

*>«)•  + wr¬ 
en  tha  first  component/ Ian*.  »i  u«  soc onu  steF/pitch  occurs  the 
redistribution  of  means;  poiut  a  passes  intc  the  point  with  the 
coordinates 

whera  x*2  (  2*,)  -  the  ccno-.tj.ouax  optimum  ccntrcl  at  the  second 
step/pitch,  in  which  irsteaa  or  is  set  Z*,. 

Eage  a4. 

On  the  second  component/ linx  or  tu»  second  step/pitch  occurs  the 
expenditure  of  the  means,  anu  point  a  is  moved  into  the  point  with 
the  coordinates 

(.<)•  =  ?(.v-:);  (y')*=t(^. 

sum  of  which  is  equal  tc  tn«  rsmaiuiag  toward  the  end  of  the  second 
step/pitch  supply  of  tte  menus 

-H 

and  s)  forth  up  to  the  latte*. /xaat  scap/pitch. 


Thus  find  the  final  soiuucr  of  tn*  problem:  maximum  income  for 
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all  a  of  steps/pitches  Vi*  auu  wort osponding  tc  it  optiaua  control 
X  *=  X*  ( x  *  i  #  x*2,  -C)  iaaiudc.*n*,  wadt  quantity  of  means  in  what 

stags  it  is  necessary  tc  SaidC<.  j.ut.o  uranch  I  (remainder/residue 
automatically  is  abstracted/*.  «u»cv»a  ;o  orancb  II). 

After  is  exanined  tee  srac*x.*,u  pcjolatn  of  dynaiic  progra aiming , 
it  is  useful  again  tc  return  to  Ub  g  ana  ral/c  cm  son/  total  presentation 
cf  a  question  into  §7  and  to  loo*,  waat  concrete/specific/actual 
embodiment  obtained  in  this  rUiu««  ciia  introduced  there 
gener al/ccmmon/tctal  ccrcept-. 

fhe  system  of  these  cca*.or  vol*.,  we  will  register  in  the  fern  of 
the  table,  divided  intc  two  tarxs  u y  vertical  feature;  to  the  left  of 
the  feature  we  will  write  tnat  va^ue,  joncept  cr  symbol  which  was 
appliad  in  general;  tc  the  r^gaw  -  corresponding  to  it  analog  in  our 
special  case. 


/2V 
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mare 

S/”S((S,.,.  U,) 

Zi  (  r.)  -j-  v  (^i  -  i  —  •>  .•) 

j(/v) 

1  DuMrpMui  ua  :-m  ui?rj  a 
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k»y 
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* 

! 
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OnTiiMa.ibHoe  KOJiitecTno 
eptACTH  no  rosaw,  a«ac.i«CMO€ 

8  OTpjCAb  I: 

.  •  •  • 

X  . xm) 

Kay:  (1).  In  general.  (2).  our  *,pacfcai  case.  ( J)  .  Physical  system 
S.  (%)  .  Group  of  enterprises  wit-a  *njtda«BU  in  them  leans.  (5)  .  m  of 
ethanas  (steps/pitches),  (o)  .  yea^e.  (/)  .  Additive  criterion 
whera  w|  -  prize  at  i  step/*.* tea.  id)  .  Aggregate  prefit  after  a  of 
years 

whera  -  income  frem  irauCues  a.  ana  il  at  i  step/pitch.  (9)  • 

Ccntrcl  at  i  st9p/pitch.  1 1o>  ^guantity  cf  teans  *;  packed  into 
tranc.i  I.  (H).  State  cf  sys-ua  ariecward  i-th  step/pitch  S;  .(12). 
Quantity  cf  means  ieiiia.Q.a^  in  ncaiches  I  and  II  respectively, 

essential  for  planning  furtnat  at«^s/ pitches  is  their  sum.  (13). 

State  of  system  after  i  st*sp/pxtcu  depending  cn  its  state  after 
(i-l)-th  step/pitch  and  coaudi.  at  i  step/pitch.  (14).  Enze  at  i 
step/pitch  depending  cn  issue  da.  (i-l)~cn  step/pitch  S;-»  and  used  at 
i  stap/pitch  control.  (15).  cadaa  spaej.  (16).  iriangls  AOB  (see  Fig. 
8.1)  (17).  Region  of  the  initial  states  of  system  S0.  (18).  Segment 

A3  (see  Fig.  8.1).  (19).  Regb.ou  or  final  states  of  system.  (20). 
Triangle  AOB  (except  fer  hypw  tanas®)  (see  Fig.  6.1)  .  (2  1).  Optimum 
initial  state  of  system,  .  Ot.tb.mua  guantity  of  means  x*|, 

isolated  in  first  branch,  ana  u®t®imiabd  by  it  guantity  of  means 
y*l=Z9-x*l,  isolatad  in  second  tta^cn.  (2J)  .  cptimux  control.  (24). 
Optimum  guantity  of  means  ov®r  years,  separating  into  branch  I. 

In  th a  following  presentation  w*li  everywhere  follow  overall 
diagram  §7,  no  longer  accent**  n/  xu  *  it  uy  so/such  comprahensive  by 
explanations. 


,  Oiitmm. i.i mioc  ynpan.-rcime 

!  w'  —  ic/;.  c/J . oj 
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§9.  Examples  of  the  tasks  soouc  cue  distribution  of 
resoutces/lif etimes. 

For  mastering  the  general  auiuauj  oc  the  task  about  the 
distribution  cf  resource s/xa^.  given  in  the  previous  paragraph, 

it  is  useful  to  use  it  cc  toe  ocuciate/specif ic/act ual  material.  Hera 
we  will  consider  two  specinc  ajLa*rlas  or  general  problem  about  the 
distribution  of  the  iescurc^>/u^atiieif  m  each  of  which  let  us 
assign  the  completely  speciLxC  roxs  of  me  function  f(x),  g(y),  *(x)r 
>(y)-  and  let  us  bring  each  or  tne  examples  tc  the  numerical  result. 

Example  1.  Is  planned/gxiatu  the  work  cf  two  branches  of 
production  I  and  II  for  period  m  ox  years. 

A  quantity  of  means  x,  *.mu«uu«d  in  oranch  I,  gives  in  one  year 
the  income 

/(x)  =  xJ  (9.1) 

and  lie  to  this  it  is  reduces  to 

s(x)  -=  0.75jc.  (9.2) 

A  quantity  of  means  y,  .itiaawd  ia  oranch  II,  gives  in  cne  year 

S  (y)  — 


the  i.jcome 


(9.3) 
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and  it  is  reduced  to 

<|»(y)  =  0,3y  ').  (9.4) 

FOOTMJTE  l.  Unity  the  measure aeut  u£  income  and  imbedded  means  must 
not  b  j  the  same.  The  c  se/a^j-AiCa'i-wn  of  formulas  c  t  type  (9.1)  and 
(9.3)  does  not  ccntradict  tn«*  t^iuciplas  of  dimeasicns.  if  means  and 
incoma  are  expressed  ir  ccmp.».  at«r.i  specific  urits  of  measurement. 
ENDFOJTNOTE. 

Page  67. 

It  is  necessary  tc  prouace  tut*  distribution  of  service  lives  Z0 
cetwaan  branches  of  the  I  au  u  to  aacn  yaar  period  being  planned. 

Solution.  Conditional  Ct-tiaum  control  on  the  latter/last 
step/aitch  (quantity  of  meaiia,  ^auiatei  in  branch  1)  is  located  as 
value  xm‘  with  which  it  ieacn«s  maximum  income  at  the  latter/last 
step/  pitch: 

w'm(Zm.,)  =  max  xjj. 

,'heCe  •«(*-.•  *.)-<+ (9-5> 

The  graph  of  function 

vm  =  vm(Zm.  v  xm) 

depending  on  argument  xm  is  rsexeseatsd  with  the  given  one  Zm- 1  by 
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certain  parabola  (Fig.  $.1)  .  ln«  j»co ad  derivative  cf  function  vm  of 
*m  is  positive,  and  therefor*  ^a^ao oia  is  ccnvertea  ccncave-up. 
Maximum  value  can  be  reacn*,a  oa^/  on  tae  borders  of  gap/interval 

(0.  zm_o*). 

FOOTNOTE  *.  Therefore  has  no  sense  to  attempt  to  seek  the  maximum  of 
function  equating  the  der-.vacav*  to  zero.  ENDFCCTNCTE. 

In  order  to  determine,  on  wn* c  rreciseiy  oorder,  let  us  substitute 
intc  formula  (9.5)  anu  xm  =  Zm_v  de  will  obtain  in  the  first 

case  (when  ■**  —  °> 

XOm  =  2Zm-l. 

in  tha  second  case  (when  xm  —  Z„.,) 

—  Z2m.,. 

The  first  value  more  than  tn«  second;  consequently,  independent  of 
value  Zm_ the  maximum  cf  moos*  *t  tna  latter/last  step/pitch 
reaches  when  •**=sW>  i.e.,  coudaawuai  optimum  ccntr ol *'m{Zm_x)  does  not 

depend  on  ,  and  it  is  always  **ual  to  zarc,  but  this  leans  that  in 
the  baginning  of  last  year  a^.1  a  v  aria  ore  means  it  is  necessary  to 
pack  into  branch  II. 
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Fig .  J. 1. 
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This  is  only  logical,  sanco  *ncou«  fcou  cni3  branch  is  acre,  but  the 
expen  iiture  of  resources  us  *»c  xu-ger  interests  (following  step/pitch 
it  will  net  be)  . 


Juring  this  optiaca  cuulcoi  ±ast  /ear  will  bring  to  us  the 


incoa* 


vr'm(Zm-x)=2 


Let  us  switch  over  tc  we  lu^inoitioo  of  resources  to  (a-l)-th 
year.  Let  we  approach  it  waw  .u#  supply  of  resources  Z«-r  Let  us 
find  the  conditional  aamiua  uicoi*  *,  n  two  last  year: 

I,  ’ft  ( ~  2  ) 

=  [  **-1  ~  •ir,-i)3+ 

~zm- 1 
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But 


Z.,_ |  —  0 . 75 jc^ _ !  -+-  0.3  (Zm_j 


and  consequently, 

<Z„.  ,)  =  2 10.75*,.,  4-  0.3  (Z„_,  -  ,)|l. 

Hence  we  will  obtain 


.i  , 


■1  I  Z -n  -  2 ) 


=  max 


i  - 1 


i-i 

•210.75*,,., 


+  2fZ,.I-x,.,)*4- 
0.3  (Z,„_;  — 


7he  expression  in  trie  catAi  u*aoaa,  briefly  designated  .  ,  is 

again  the  polynomial  of  tne  »iCQu u  dagree  relatively  r~  >  with  the 
positive  second  derivative,  &aa  grapa  *  paranoia  with  convexity 

downward,  so  that  it  is  agax*.  u*.c»»sar/  to  trace  tc  the  aaxiaua  only 
the  axtreae  points  of  ictervul  if**.  V.  2)  : 


A  •»-  I 


=  o  <>\ 


~  Z. 


Key:  ( 1)  .  and. 


In  the  first  case  (when  r„  ,  —  ot  wxl*.  oatain 

a  2Zi,_2-2<O.JZ,_:>;  *=2.180^.:; 

in  the  second  case  (when  xm_,~=Zm_t) 

»,;-I.*«ZiI.14-2(0.r5Z„.j)J*:2.l25/i.;. 


DOC 


80151504 


PAGE 


whenca  it  is  clear  that  the  i jam  reaches  whan  —  and  is 

equal  to  w’m_Um(Zm.2)=  2.I80Z?,.,.  x.  ac  ;he  next-tc-iast  step/pitch  it 
is  necessary  all  resources  tw  iato  branch  II. 

uet  us  pass  toward  (a-^  -cu  to  s  to  p/p  itch.  It  is  here  necessary 

to  aaxinize  the  polytcixal  a*.  secoad  degree 

V:-7.m-l.m  =  x*m_i  + 

+  2(Zn,.J  — 

-+•  2.18  I0.~5jc/m_j  -p- 
+  0-3(/,_3-x._1)|J. 

The  correspcnding  parauwla  (as  on  any  cf  the  steps/pitches)  will 
be  again  converted  ccncave-u^.  uuw  taxs  tine  aaximui  will  be  reached 
not  oa  the  left,  but  cn  toe  uXjux.  nocder  of  section  (Fig.  9.3). 
Actually/really,  assunirg/sw*. =  we  will  cttain 

W,:.  2.  2Z?,l_;1-j-2.IS(0.3Z„,_;1)^  ^  2.20 2Tm.i, 

but  wnen  xm_2  =  Zm.i 

vl-t.  m-».  ■n  =  z\-2  +  2.18(0.75Z*_j/  «  2.23Zi,.3 
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Consa  luently,  conditional  o^viJiaiu  coatcox  at  (m-2)-th  step/pitch  will 

faa  3- 

i.e.,  on  this  step/pitch  opt-auia  concrjl  lies  in  the  fact  that  all 
available  resources  tc  jacx  *nto  *i£aaca  I.  In  this  case  we  will 
obtain  the  conditional  zaxxaua  income 

m-l.  m  (Z.it- 3>  =»  2.23Z;„_j. 

It  is  obvious,  in  all  tolo-cw^ng  stages  the  maximum  will  be 
alwaya  reached  as  in  Fig.  at  the  nyut  er.d/lead  of  the  segment. 

Actually/really ,  for  i<«-2  tunctxon  . m  will  take  the  form 


. 

=  xi 4.  2 (Zi-x  —  *!>*+  c  [0.75X,  +  0,3  *,)!’• 
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where  coefficient  C  will  ob  »o;;o  tnan  z.13,  since  it  with  each 
step/pitch  cnly  increases.  uwcaZuie  optimum  ccnditicral  control  to 
the  vary  first  step/pitca  ii^cius.*  veiy*  it  will  remain 

•V;  (Zj_,)  =  Z|_,  (/  =  in — 2,  rn  —  3.  ...), 

and  conditional  maximum  income  rox  an  ste ps/pitches,  beginning  from 
the  i-th,  it  will  be 

IV'i.  (  +  1 m  (Zi-0  —  £t-i  ■+■  *• * (0.75Zj_0* 

Thus,  optimum  control  i>  rou*a:  it  lies  in  the  fact  that  at  all 
steps/pitches,  except  rext-tw-x at»c  aud  latter,  to  pack  all  resources 
into  oranch  I,  and  at  twc  id.';4./i.asc  steps/pitches  to  pack  all 
resources  into  branch  II.  iex  u*  -ota  ifaat  this  solution  is  obtained 
independently  neither  cf  a  auaoei  of  sceps/pitches  ir  nor  of  the 
initial  supply  cf  resoticas  i  a. 

In  order  to  visualize  tae  tic.e  j£  optimum  trajectory  in  the 
phase  space,  let  us  assign  tae  ooucra ia/specif ic/actual  value  of  a 
number  of  steps/pitches  a=b  ^prwoactxoa  process  is  planned/glided  to 
5  years) . 

Page  71. 

Optimum  trajectory  is  repres«ntta  in  Fig.  9.4.  Optimum  control 
process  cf  resources  consist*  ox  one  tallowing.  Tc  the  first  year  all 
resources  are  packed  irtc  uix ac a  ±  au  d  are  reduced  to  0.75  Z0.  By  the 
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second  year  -  into  the  sane  acaucu  I  tney  are  reduced  tc  0.56  Z0 
(thera  is  no  redistribution  w f  i.ejuuccjs,  and  therefore  the  second 
compoaent/lin k  of  the  seccna  fir cti  vanishes).  Cn  the  third  year 

again  all  resources  are  pacxed  xuco  tna  same  branch  I  and  are  reduced 
to  0.42  Z o •  On  the  fccrtn  year  policy  varies:  occurs  the 

redistribution  cf  resources  ^  luci^ued  trajectory  phase)  ,  they  all  are 
packed  into  branch  II  aca  ai«  xeaacei  to  0.12  Z0.  On  the  latter,  the 
fifth,  to  year  again  all  Cesuurv;^  ara  packed  intc  branch  II;  their 
remaiader/residue  at  the  enu  of  tae  rifth  year  (and  entira  period) 
will  oe  equal  tc  0.04  20.  bu^in*  „ais  distribution  cf  resources  in 
the  five-year  plan  will  oe  Qu  ca^aea  the  maximum  inccae,  equal  to 

W’  =  2.27  Z,{. 

Cf  this  example  optimum  ccauci  consisted  of  at  each  step/pitch 
packing  cf  all  resources  either  ^«io  oae  or  intc  ancther  branch. 
Always  whether  this  will  be  thus/  mow  we  will  ascertain  that  not 
always.  For  this  change  the  ..cxm  ox  taa  function  f  (x)  and  g  ( y ) - 

Example  2.  Is  planned/y^  iu«u  tha  activity  cf  two  branches  of 
production  with  the  I  ana  xi  pe*i wa  to  5  years  (a=5) .  The  "functions 
of  thi  expenditure  of  resouxoas"  v>ix)=J.75x  and  v()0  =  0.3y  the  same  as 
in  tha  previous  example,  out  tus  "xunction  cf  the  inccae”  of  f(X)  and 
g(y)  jf  the  replacenent  a y  o. hexs; 

/  (x)  —  l  —  e~*\  «.'(>')=  1  —  e~'‘y- 
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miJL 
Fig.  9.4. 

Kay:  (1).  Redistribution. 

Page  72. 

It  is  necessary  to  distriout«  avaxlaole  rescurces/lifetimes  in 
size/liaensicn  cf  z0  =  2  tazwe*a  I  and  II  ever  the  years. 

Jolution.  In  the  previous  •  xaiupj.e,  in  connection  with  the  very 
simple  form  of  the  function  ■£  (xj  »ud  g(y),  the  solution  was  given  in 
the  analytical  fern;  in  tn^s  •xan^xa  to  construct  the  analytical 
solution  is  difficult,  and  *»  wixx  solve  prcblea  numerically.  The 
meeting  in  the  task  functional  attendances  *e  will  represent  with  the 
halp  of  the  graphs.  Let  at  tug  ugr^mauy  of  the  fifth  year  a  guantity 
cf  rasources  be  equal  ?«.  xn  cru«x  to  find  conditional  cptiaus 
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control  cn  the  fifth  ste p/pit.cn  x*s(Z*),  it  is  necessary  for  each  Z* 
to  find  the  maximum  of  tne  tancawk 

a',  —  v-  =  i  —  e-  (*4-  i  —e-21*'-**  = 

~  2  —  (*-*  +  (9  6) 

with  chat  fixed/recorded  Z4  tnis  -.s  -  the  function  cf  argument  x5, 
convex  upwards  (Fig.  9.5).  l^a  maximum  ot  this  functicn  (depending  on 
value  of  Z4)  can  be  reached  aa«<-  vitain  segment  (0,  Z4)  (as  shown 
in  Fij.  9.5a),  or  at  his  let.  uau/iaai  (Fig.  9.5  b) . 

In  order  to  find  this  maximum,  iet  as  differentiate  expression 
(9.6)  on  x 5 .  If  derivative  t«.cca*s  zaro  at  certain  point  within  the 
segmeat  (0,  Z«),  then  at  tala  pcoa»t  ceacaes  maximum  W;  if  outside  - 
maximum  reaches  at  x,=C. 
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Pig.  A. 5. 

Page  73. 


Jif ferentiating  ($.6)  aav« 

^  =e-'~  2* =0.  (9.7> 

.\t  this  step/pitch  equation  i*./)  to  us  still  it  is  possible  to 
solve  in  the  literal  feu;  a*.  runner  steps/pitches  analogous 
problems  we  will  solve  Euitoi.icai.lj.  Proa  (9.7)  we  have 

—  jcs  =  In  2  —  2Z,  +  2xs;  x^=  2Z,-~  -2  .  (9.8) 
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S(Z<)  —  \  2Z.  —  I  n  2  0 


r  /  In 2 
npw  Zt  <  — rj-  . 


I  2Z,-ln2  U  ...  'n  2 
— !-3 -  np)t  Z^-j-. 


,9.10) 


Kay:  ( 1)  .  with. 

cat  us  find  conditional  ma.iu.mua  income  in  the  fifth  year.  It  is 
equal  to 

tt^(Z,)  =  2  —  (  +  « 'JK'rs(7',l  / .  (9.11) 

or,  substituting  (9.10)  in  (a .  1  1)  , 


U^(Z.,)  = 


Key:  (1).  with. 


^  in  2 

I — e~2Z>  npw  Z4  <  — y-  • 

1  -  -4  z.  ®  7  .  In  2 

—  T  V  2  e  -1  npii  Z,  >  -7-. 


(9.12) 


Since  for  us  it  is  nece-.suij  *aay  times  to  compute  value  W*s,  it 
will  oe  convenient  tc  construct  jcuph  depending  on  Z4  (Fig.  9.6). 


Page  74. 

On  th  i  same  graph  (but  cn  ouer  scale)  let  us  depict  the  dependence 
cf  conditional  optimum  ccntid  ac  the  fifth  step/pitch  **5  cn  Z4. 
with  the  construction  of  tne*«  tec  graphs  are  finished  our  all 
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natters,  connected  with  the  n.rrta  stap/pitch.  Subsequently, 
optimizing  control  at  the  uiuiiii  atep/pxtch,  we  will  only  enter  into 
these  graphs  with  different  vaiua*  or  Z*. 

we  pass  to  the  fourth  s^ep/^tcu.  Taa  task  of  its  conditional 
optimization  we  will  solve  nu  aei.-i.call y,  using  assigned  the  series/row 
of  values  Z3  (supply  cf  the  «.esuiu.ces,  watch  remained  after  the  third 
step/pitch).  In  order  ret  to  naxe  excess  work,  let  us  explain,  within 
what  limits  can  be  fcunc  Zj,  Let.  as  trad  the  largest  cf  possible  of 
values  Z3.  It  will  be  achiev* a/ coached,  xz  at  the  first  three 
steps/pitches  all  resources  aiaa.  we  uuedded  in  branch  I;  in  this 
case  the  supply  cf  resetrees  arte*  tnree  years  will  be  equal  to 

Z,m„  =  A-  0.751  =  0.344. 

The  smallest  supply  cf  resources  ^orr wspoads  tc  tae  case  when  all 
resources  at  three  first  see* s/titchas  ara  imbeddad  in  branch  II: 


^.1  min  —  Z0  ■  0,3J  —  0.054. 
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Page  75. 


Thus,  all  possible  values  atu  included  in  the  section  from 
0.054  to  C.  844.  Let  us  assig*  xu  »nis  section  reference  values  of  Z9: 

Z3  =  0.l;  0.2;  0.3;  0.4;  0.5;  O.f,;  0.7;  0.8  (9  13) 

and  for  each  of  thee  let  us  *.auu  coni  it  tonal  cFtiaua  control  on  the 
4th  step/Fitch  x*4(Z3)  and  c«  nuit*cnd  1  maxima  incose  at  two 
lattec/last  steps/pi teles  u*«.si  *3).  for  this  let  us  construct  the 
serias  of  the  curves,  uhicn  prize  4 ?«,  s  at  two  latter/last 

steps/pitches  (during  ary  cc.uci  on  ue  fourth  and  with  the  optiaua 

x<)4- 
+  Vi  (0.75x4  + 

+  0.3(Z3-x,)), 


on  the  fifth)  : 
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whera 

(Z3-  xi)  — 

=  2  — [«“•'«+  e~7iZ>-r<>\. 

and  '4*s  we  find  through  the  ^ra^n/curva  Fig.  9.6,  input  into  it  with 
argument  Z4=0. 75x4»0. 3  (Z3-x^  .  iu«  curves  of  dependence  l^4%  cn  x4 
( w i ta  the  given  one  Z3)  are  ..eprtesfcnteu  in  Fig.  9.7.  For  each  of 
thesa  curves  let  us  find  fo-wt  warn  cne  aaxinum  ordinate  and  will 
■  ark  ay  its  snail  circle,  in®  orumi .aca  or  this  point  for  that 
corraaponding  tc  the  curve  is  conditional  xaxiaun  prize  at  two 
lattar/last  stecs/pitctes  iv'I,5(Zj).  o®u  abscissa  -  conditional  optimum 
control  x*4(Z3).  After  determining  taese  values  for  each  value  froa 
(9.13),  let  us  construct  tne  gr a*u/diagraas  of  dependences  ir 4’; (Z,)  and 
x]iZ})  (Pig.  S.8). 

iy  the  ccnstructicn  or  whose  two  curves  we  finished  our 
calculations  with  twc  latter/ last  at* pa/ pitches:  all  inforaation 
about  then  is  already  included  m  of  two  curves  of  Fig.  9.8. 
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Fig.  i.  7. 


Page  76. 


4a  pass  to  the  third  su t/r*.ch.  rtua  region  of  tha  possible 
valuas  Z2  lies/rests  between  2«o.j*=0.18  and  2«C.  75*=1.  12.  Ue  ar~ 
assigned  in  this  interval  a  y  tae  series/r  ow  of  reference  values  Z2  : 

Z,  =  0.3;  0.5;  0.7;  0.9;  1,1 

and  far  each  of  these  values  iet  us  compute  ireeme  cn  the  third 
step/pitch  depending  cr  ccnc^ci  Xj  at  this  step/pitch  according  to 
the  fornula 

xp5(Zj.  acj)  =  2  — 
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Then  let  us  adjoin  tc  it  tae  UA.eauy  optimized  income  at  fourth  and 
fifth  ste ps/ pitches  i&VdA)-  »«aca  «*>  mil  determine  cn  the  graph/curve 
Pig.  4.8,  entering  it  vita  ue  vai.be 

Z4  =  0.75*, +  0.3  (*,-*,). 

and  via  vill  obtain  the  value 

ll'i  4  s  ~  (/-t.  x$)  5  (0.75x3  -4-  0.3  \7.n  —  vii  )• 

for  waich  let  us  again  const..  jci  »ae  graph/diagrams  of  dependence  cn 
x3  with  that  f ixed/reccruea  t2  4.4).  Fcr  each  of  these  curves 

let  iij  again  find  the  maximum  (xu  tha  figure  it  is  noted  by  small 
circle)  and  after  this  mill  consul uct  one  dependence  cf  tae 
conditional  optimum  ccnticx  at  tn«  taird  step/pitch  x*3  and  of  the 
corresponding  tc  condition  maximum  income  at  three  lattec/last 
steps/pitches  **3.4. «  cn  Z2  trxa.  a.  10). 
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o  j<  u  u  j<  -’5  :i  .i  :s  'a  \ i ’’ 


Fig,  A. 7. 


Pag*  78. 


Analogously  is  sclv«a  zu4  l*e  or  the  conditional 

optiaization  of  the  seccnd  are  varied  values  Z 

2«0.  1-0.6  to  2*0. ~l-  1. 5; 

Z,  =  0.G;  0.9;  1.2;  1.5. 

Incoaa  at  the  second  stef/txtc u  via!  he 


f  roe 


!0;(Z,.  Xj)  =  2 — e-7,z>- r>*J. 
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To  it  is  adjoined  the  ccodiucudi  «aiuui  inccrae  H*3.4.s  on  the 
jraph/curve  Fig.  9.10  witn  ud  ^ut 

7,  =  0.75.tj  0.3  (Z,  —  jtj): 

it  is  obtained  value  xOx  «tica  again  they  are  constructed 

graphs  (Fig.  9.11).  Cn  eacn  v«  is  located  the  aaxisui  and  are 
constructed  two  curves:  ana  d*{  .3.4.s  (Zt)  (Fig.  9.12), 

it  regained  to  plan  cu  tm.sc  step/ pitch.  This  -  already  sore 
easy  prcblea,  since  value  area  wurch  we  tegin  this  step/pitch,  it 

is  accurately  known  (Z0-2)  a-i  xt  xusi  not  be  varied.  Therefore  for 
the  first  step/pitch  is  censor uct«u  only  one  curve  dependence  W,*2.j>«,5 
cn  xt  (Fig.  9.13),  where 

'.t' •.  =  c?i  < 7,i.  .r i )  'X'z,  j.  4.  s  (Zi)  = 

|+ <3.  «.3(Z,)t 

and  Littec/last  tera  is  located  tutoaga  tae  graph/curve  Fig.  9.12 
*ith  Z,  =  0.75  r,-j- 0.3  <Z„  —  .t,). 

where  Z„=2. 

oeternining  in  the  um^a  curve  of  Fig.  9.13  maximum,  we  find 
(nc  longer  conditional)  cptxxu*  tutu oi  on  the  first  step/pitch 
x • , *  1 . 6  and  correspcrdicg  taxis  a*  *acoae  in  all  five  years 

*•,< 3.  4.i*4.35. 


After  this,  as  always  iu,  ua  ateuaod  of  dynamic  programming,  it 
is  necessary  to  construct  ccm^eta  optimum  ccrticl 

.V  =(.V,.  Xv  X4.  xr), 

going  in  the  opposite  direct^cm.:  zj.oim  tne  first  step/pitch  toward  the 
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knowing  optimal  cauUJ.  cu  first  step/pitch 

,t;  -  1 .60. 

we  find  the  corresponding  to  i*.  aafpj./  or  resources  toward  the  end  of 
the  first  step/pitch: 

=  0.75a-;  +  o.3(z0-.,-;)=  i. ,32. 

Entering  with  this  value  cr  Z4  grapn  x*2  (Z)  (see  Pig.  9.  12)  ,  we 

find  jptimun  control  cn  tne  .»«ccau  step/pitch: 

=  1 .02. 

The  ramainder/resid  ae  cf  r«s source.*  tjuard  the  end  cf  the  second 
step/pitch  will  te 

z;  =  0.75.,-;  4-  0.3  (z;  —  *;)  =  0,86. 

aith  this  value  cf  Z2  we  ett^r  au.v.  graph  x*3(Z2)  (cm  Pig.  9.10)  and 
find  nptiirua  control  cn  th*»  .0 atap/picch: 

■*3  ~  0-62. 

The  r aaainder/residue  cf  resources  after  the  third  step/pxtch  will  be 
Z*3  =0. 7 5x*3 *-0.  3  (Z*2- x* 3 )-0.  .  i'iifcuagh  tna  graph/curve  Fig.  5.8  we 

find  jptimun  control  cn  th«a  ..ourcu  step/pitch 

=  0.30. 

After  the  fourth  step/pitca  .a«  r«*aiader/residue  is  equal  tc 

z;  =  0.73 ,;  4  0.3 (z;  -  x,)  ^  0.50. 

with  this  value  of  Z4  w«  ertui  ruco  graph  x*5  (Z  J  (see  Fig.  9.6)  and 
find  aptiiua  control  cn  the  a.  a.  to*/lasc.  step/pitch 
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Page  31. 

Thus,  planning/gliding  is  completed.  Is  found  the 

optimum  control,  which  mdicutsa,  new  many  resources  from  the 
available  supply  Z0  =  2  it  is  ueces^ary  to  pack  into  branch  I  ever  the 
years: 

A'*  =  (1.60;  1.02;  0.02;  0.30:  0). 

"faking  into  account  tnat  tue  supplies  of  the  resources  before 

beginning  each  year  are  Know..; 

Z,>  =  2;  Z*  =  1 .32;  Z]  =  0.8<5;  Zj  =  0..54;  Zi=0.3(). 

we  automatically  obtain  vjudi.u.da  of  resources,  packed  over  the 
years  into  branch  II: 

y;  =  -  x\  =  0.40;  y;  =  Z[  -  x\  =  0.30; 

y; = ^ -  *3‘  -  o-2^  y\  =  -  •<  =  °'24; 

y\  =  Z*  —  x’s  0.30. 

Thus,  it  is  possible  tc  formulate  the  following  recommendations 
regarding  the  optimum  distriiutn.ii  of  resources.  From  the  available 
in  the  beginning  period  of  tue  su^iy  of  resources  Z0=2  and  remaining 
resources  at  the  end  of  eaun  year  it  s  necessary  tc  pack  over  the 
years  in  branch  the  I  aid  li  following  sums: 


DOC 


*0151505 


F  AG  £ 


( 


To/i 

1-A 

2- a 

3- a 

4-ii 

5-»i 

1 

1.60 

1,0-2 

0,62 

0.30 

0 

II 

0,40 

0,30 

0.24 

0.24 

0,30 

During  this  planning/ jJ-.dioa  Mill  oe  obtained  maximal  return  in 
5  years,  the  equal  tc 

W i.  j.  3,  <.  s  ~  1.35. 

fteaainder/residue  of  resources  an  the  ana  of  the  period  will  te  equal 
to 

0.3  •  0,30  =  0.09, 

Pig.  9.1U  depicts  the  o*.  tiaua  trajactory  in  the  phase  space, 
which  corresponds  to  this  ax* tr mutio a  ol  resources.  Point  S*0  on  the 
hypotenuse  of  triangle  AOB  io  pE*n»*Lts  t a*>  optimum  initial 
distribution  of  resources  wiwu  sharp  predominance  tc  the  side  of 

branch  I.  The  first  cc BpcneuL/i^a*.  of  oroaen  line  corresponds  to  the 
expenditure  of  resources  in  waa  txist  year. 

Page  <32. 

The  following  component s/lin*. s  ai«  joined  they  pair-wise  and 
represent  redistributicr  ana  exr»uuitura  of  resources  on  the  2nd, 

3rd,  4th  and  5th  years.  Latter/ ait  c  oiapouent/link  lies/rests  on  axis 
Cy;  this  ireans  that  on  the  on  a  ;ui  of  production  process  all 
resources  are  packed  irtc  htauca  11.  Poitc  sl0.  represents  the 
reaainder/residue  of  resources  a**-0.  J9,  which  is  obtained  during  the 
cptiaua  planning/gliding. 
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§  10.  Modifications  cf  the  taS*  auouc  tab  distribution  of 
resources/lif etimes . 

the  examined  in  twc  pie* icus  paragraphs  task  about  the 
distribution  cf  resour ces/ix.  auiss  n  us  many  modifications.  Seme  of 
them  comparatively  differ  ix.uo  no  a  tub  simplest  task,  examined 
into  9  8;  others  so  differ  acu  u  in  their  vertal/literary  setting, 
which  is  sometimes  difficult  to  uncover  in  them  general/ccmmcn/total 
features.  In  this  paraccapn  ana  .ii  tnosa  following  (§§  11.12)  we  will 
consider  the  series/row  of  ud  versions  of  similar  tasks. 

a.  Distribution  cf  resources/ j.ir  at ivas  in  heterogeneous  stages. 
In  tha  task  §  8  stages  (stepa/picones)  w»*re  "uniform"  in  the  sense 
that  resources  x  and  y,  imreujeu  respectively  in  branch  I  and  II,  in 
any  stage  gave  one  and  the  same  imcoiis  and  were  reduced  in  an 
identical  way  independent  ox  cats  aumoer  of  stage. 

Page  83. 

The  natural  generaliratx.cn  u.  ta  is  simplest  task  is  the  case 
when  income  and  loss/ de precia tion  of  resources  in  different  stages 
are  dissimilar:  resources  x,  y ,  x.areideu  in  branch  I  and  II,  give  on 
the  i-th  income  /<<*)•  g,(y)  anu  tn*^  are  ceuuced  tc  ?,(*)  < x,  |,(y)  < y. 
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low  can  arise  this  hettu.  og«u«ity  ?  3y  different  methods,  for 
example,  profitableness  can  uapouu  oa  the  ccucn  level  cf  the 
development  of  production,  dwiuevt u/c eached  tc  the  defined  period;  or 
the  condition  of  producticu  la*,  ^et  us  say,  in  the  agriculture)  they 
can  depend  on  season. 

For  the  solution  cf  tn«s  prevail  of  uistributing  the 
resources/lifetimes  by  the  m«>taoa  of  dynamic  programming  this 
circumstance  -  uniformity  cx  a«t«M.cgeaaity  stage-  is  completely 
unessential.  Since  the  ptoux«ffl  cl  the  optimization  of  control 
nevertheless  is  sclvtd  in  au^<u>,  it  is  completely  unimportant,  are 
identical  functions  /<(•*)•  ?/(•*)•  h  O’)  Aa  the  different  stages  or  they 

are  different. 

The  overall  diagram  ox  »n*  swiucion  is  reduced  tc  the 
consecutive  use/applicaticn  ct  t a«  following  formulas  for  the 
conditional  optimum  income  i u  sev«ial  latter/last  stages: 
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K  (z,-i)  =  {/"(xJ+gJ-Z* -~xj\: 

{J^xm  ^  ‘‘m-  j 

~i“  t'm-l  (^/n-2  '•m_  |)  ))  ■ 


W 


lux,....m(z,.  i)  =  n  ma*  |/ifjci)  +  .?I(^.,-'f/)-r 

0  <  ,r(  <  Z(  _  , 

+  *^1.  ....  m  (?(  (*<>  +  ^  (Z,.,  —  X ,)  ;|  . 


with  the  incidental  deficxtxon  cr  tha  conditional  optiaun  controls: 

. X\(Z,). 

^fter  this,  as  always,  is  consrxuctei  optmun  control,  beginning  frca 
the  fir3t  stage  and  ending  w*tn  u«  latter.  In  this  construction  of 
there  is  no  difference  witn  ctu  case  or  anifcrn  stages. 


Page  34. 


3.  Task  about  redundancy  or  t«»so urces/lifetiaes.  Task  is  placed 
as  follows.  There  is  only  on«  crunch  or  production  and  certain  supply 
cf  resources  Z0,  which  can  um  p«c*«d  xa to  the  production  not  wholly, 
but  partially  be  reserved.  Sex a*  rn  c  ha  production  in  the  i  stage,  a 
quantity  of  resources  x  xaoedleu  jxvas  income  /({.v)  and  and  it  is 
reduced  to  ■sl(\)<x.  it  is  nec^ssa*.,!  to  rationally  distribute  the 
available  and  reeaininc  resources  u.n  a  stages  in  order  to  becoae 
■axiaun  aggregate  prefit  «u 
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It  is  not  difficult  to  bSo^koij  cnat  this  task  is  reduced  to 
previous.  Actually/really,  tua  .«a«rv£a  rescczces  can  be  considered 
"imbsdded"  in  certain  factitious  "secoaa  oranch"  of  production,  in 
which  the  resources  are  act  *xpeaucd,  out  alsc  they  dc  not  give  the 
incca  a: 

C,  i  y)  =  0;  ^  (V)  —  y  (i—\.  2 . nt). 

Talc  in  }  into  account  this  ccnuitoua  pcoulea  is  sclved  in  exactly  the 
saae  way  just  as  the  task  cl  distiibutiu g  the  r esources/lif etiaes. 

The  trajectory  cf  point  i,  wuo.cn  represents  the  state  of  system 
in  the  phase  space,  will  tux*  cm  l ore,  represented  in  Fig.  10.1.  The 
sections  cf  the  "redistr icuucu  or  resources"  will  te,  as  before  they 
are  parallel  to  line  AE,  uu.8  soc&icas  cf  the  "consumption  of 
resources"  -  are  parallel  to  uu»  axis  of  abscissas  and  are  directed 
to  the  left.  The  latter/laut  compouen t/link  of  broken  line  will 
always  lie/rest  on  the  axis  w£  auscissis,  since  further  redundancy  of 
resources  a  sense  does  ret  o«ve. 


let  us  consider  a  special  case  of  tae  task  about  the  redundancy 
when  in  all  stages 


-3,  <  x )  —  0. 


i.e.  the  imbedded  resource*  ar«  «xreu  de  i/consuaed  by  pillar.  Then  the 
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task  of  the  redundancy  cf  i  is  reduced  to  finding  of  the 

saxiaan  cf  the  fcllowirc  fusot^cu  «  of  arguments: 

•n 

^  =  '  (10.1) 

13  ( 

where  at,.  x7 . xm  United  i»y  u<>  ccniicions 


>n 


I  3  I 


*,>0.  (10.3) 


3_ 

■r 

Fig.  10.1. 

Fage  d 5 • 

If  we  income  f,(X)  (as  this  assume)  is  the  ncndacreasing 

function  of  the  imbedded  resources  x,  cnen  the  sign  of  eguality  in 
formula  (10.2)  can  be  r e jactwa/ tuicwa ,  since  under  these  conditions 
to  expend/consume  not  all  resources,  but  only  their  part  is 
disadvantageous. 

The  trajectory  cf  tout  s  is  the  pause  space  will  appear,  as 
shown  in  Fig.  10.2  -  each  aoi.iacec.al  section  reaches  the  axis  of 
crdinates. 

let  us  do  seme  cfcser various  auout  cue  methed  cf  the  solution  of 
problae.  Above  we  saw  that  s«a  was  rs  auced  to  the  aetermination  of 
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the  maximum  of  function  (10.1).  it  Ciq  deem  that  thereby  the  task  is 
sinplified,  according  tc  t ns-,  iMrxtssioa  illusory.  Indeed  generally 
the  task  cf  finding  the  zaAixurn  01  ta a  function  of  many  arguments  is 
rot  an  easy  one.  Let  us  recall  ^  1)  that  any  task  cf  optimum 

control  is  always  reduced  to  UuUxiig  tua  maximum  (minimum)  of  the 
function  cf  many  arguments,  una  ^ncisjiy  in  order  tc  avoid  the 
connected  arguments,  anc  precisci;  in  order  tc  avoid  connected  with 
this  difficulties,  we  resort  to  tn«  metaod  cf  dynamic  programming. 
After  giving  here  formula  (10.1),  we  did  not  intend  to  facilitate  the 
task  of  dynamic  programming,  ait «i  reducing  it  to  the  task  of  the 
determination  of  the  maximum  ci  lunction  (  10.  1 ).  On  the  contrary,  for 
the  solution  of  the  prctlem  o£  tue  datar mi  nation  of  tha  maximum 
(minimum)  of  function  cf  ilO.l)  wxta  conditions  (10..!)  and 

(10.3)  (wherever  this  tas*  nut  xt  arose),  can  prove  tc  he  most 
adeguate/approaching  precisely  u«  matnod  of  dyramic  programming.  By 
the  use/applicaticn  cf  this  macuou  in  tais  case  we  bring  the 
multidimensional  task  cf  final*;,  tae  maximum  cf  the  function  cf  many 
variaol 3/alternaticg  tc  the  .«ttaud  determination  cf  the  maximum  of 
the  function  of  cne  var labia/ ax tornat lug ,  which  is  considerably 
easier. 
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Fig.  10.2. 

Page  36. 

net  us  note,  however,  u.a.  sane  simplest  cases  of  tha  task  of 
the  radundancy  of  resccrces  tolamjntary  solution,  also,  without 

the  use/a pplication  cf  a  e>uou  or  dynamic  Frc9i4BBing.  To  them 
belongs,  for  example,  simplest  caa«  waan  the  "function  cf  income"  in 
all  stages  is  one  anc  tie  same; 

/,(*)  =  /,(.<)=  ...  =  fm(x)  =  f(x). 

moreover  resources  in  each  stage  a^e  ex pended/ccnsu med  completely: 

?l  (x)  —  ?2  (.t)  =  ...  =  ■?„  ( X )  —  0. 

it  is  possible  to  demcrstrat*  that  if  function  f(x)  -  function 
nanotonically  increasirg  ana  is  catva*  upward  (Fig.  10.3),  then  the 
maximum  of  expression  (10.1)  rsacm.s,  wnen  resources  sre  divided  into 
egual  parts  between  all  stages; 
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c.  Task  about  the  qxsu.ouuuu  af  tub  resource  s/li  fetimes 
between  several  (mere  than  li  two)  braacnes.  The  task  about  the 
distribution  cf  reso  trees/ aii.  o^imea  alaows/assutas  generalization  tc 
the  case  when  resources  arc  a  iau.-t.uut  ei  not  between  two,  out  between 
k  branches: 

I.  I' . (A). 

moreover  for  each  (j-th)  bra.*ca  tuey  ace  preset:  the  "function  of 
inccma" 

/'/’(*). 

expressing  the  income,  giveu  a  quantity  cf  resources  x,  imbedded 
in  th  a  j-th  branch  at  tie  i  -a  t«t/  ^iton,  and  the  "furcticn  of 
expenditure" 

showing,  to  which  value  uecicases  a  gumtity  cf  resources  x,  imbedded 
in  tha  j-th  branch  at  the  * 
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let  us  construct  fcr  nnu.s  rao*.  padau  space.  In  the  case  cf 
distributing  the  resources  accoraing  to  two  branches  such  phase  space 
was  triangle  A03  (see  Fug.  o.  1,  o.^,  etc.)  .  Fcr  the  case  of  several 
brancaes  it  is  possible  as  me  tu* *>e  space  to  consider  the 
multidimensional  generalization  or  triangle  (which  is  ccnventionall  y 
designated  as  "simplex"),  na. teiy  tne  point  set  cf  It-  graduated  space, 
which  satisfy  the  conditions; 

2  xli)  <  Z0;  xU)  >  0  ] 
i  (10.4) 

((/='•  II . (*))•)  J 

In  the  case  of  the  space  or  »nr««i  measurements  (which  correspcnds  to 
the  distribution  of  resource*,  according  to  three  branches)  simplex 
will  take  the  form  of  tetrahedron  (Fig.  10.4)  whose  three 
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edges/fins,  that  converge  j.n  tu»  a^ginaing  cf  coordinates,  are  equal 
to  7.0 .  The  process  of  d  isti  iw  ut  tae  resources,  as  in  the 
two-dimensional  case,  it  can  te  uiviidi  into  the  cospcnents/linlcs, 
which  correspond  to  the  "Cfecu.Sw£j.nutioa  ot  resources'*  and  to  the 
"expenditure  of  resources",  *crBcvter  on  tae  first  ccmponents/linlcs 
point  S  moves  on  the  plane,  tdj:duel  Aac ,  and  or.  the  second  it  moves, 
receding  from  plane  ABC  into  tat  u«»pcn  or  simplex. 


Fig.  iG.u 
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§11.  Task  about  the  distrauu  uju  of  rssources/lifetimes  with  the 
enclosure  of  incomes  intc  x.aa  production. 

Jntil  now,  in  all  tas&s  excuiu^ei  xuout  the  distribution  cf 
rasourcas/lif et imes  we  exama*eu  uib  *ucoa6",  yialded  by  production, 
ccmplately  independent  cl  me  axscxxuuted  basic  means  (it  even  could 
be  expressed  in  ether  unit/,  fo..  axampiet  r escurcas/lifatimes  -  in  the 
man-hours,  and  income  -  an  u.a  autij.es  or  an  the  meters  of  fabric). 

Page  88. 

In  this  paragraph  we  w.u.i  consider  tnat  case  when  income  can  (in 
full  or  in  part)  be  packed  a- co  tat,  production  together  with  the 
basis  means.  For  this  it  goes  watucut  sa/ang  the  inccme  and  basic 
means  must  be  given  to  cne  iuvat«nt  (i or  example,  to  the  money). 

Depending  on  situataon  tnxs  casit  can  be  placed  differently,  with 
the  different  critaria  W.  example,  at  is  possible  zc  pack  into 
the  production  entire  income  or  at*  only  certain  of  f ractaon/Fortion. 
It  is  possible  tc  seek  suca  ocntrox  waxen  ensures  maximum  total  net 
incoma  from  m  stages.  It  is  t.  ossaoxe  to  seek  such  ccntrcl  which 
converts  into  the  maximum  u«  tot  ax  sum  of  resourcas  (switching  on 
inccma  and  preserved  kasac  mod after  m  stages.  Ar9  possible  ether 
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f  or  mu  La  t  ions  of  the  problem.  uaie  «e  will  show  the  diagram  of  the 
solution  by  the  method  ci  tnu  i^nauic  programming  of  several  simplest 
tasks  of  such  type. 

a.  Let  us  consider  cast*  wn«u  income  is  packed  into  production 
completely,  moreover  is  sanmiit.u  sum  of  all  leans  (basic  means  plus 
income)  after  m  stage. 

In  this  case  criterion  W  is  cue  sum  of  all  resources,  which  were 
preserved  in  both  tranches  di.te.  cue  a  scage,  plus  the  income,  given 
by  both  branches  in  this  sta^e. 

The  criterion  *  ir  gueswUcn  a  special  casa  of  the  additive 

criterion:  it  entire  is  ac^u-reu  cue  last  stage,  i.  a. ,  \v  =  wm.  and 

in  all  previocs  stages  its  lucreases  »,•  are  egual  tc  zero. 

Since  all  resources  (ana  cn«  ^emainder/residue  of  bases,  and 
income)  are  packed  intc  the  ^roauccion  and  are  considered  in 
criterion  w  on  the  equal  bas<,s/LaseS,  then  to  us  to  unnecessarily 
hare  ouild-in  separately  tne  “functions  of  income"  /,(*'•  iV'd  and  the 
"functions  of  expenditure"  r, '<<>'••  ini  is  sufficient  tc  introduce 
two  functions 

l\(\).  <#,(>•).  (ii  i) 


showing,  hew  many  resources  ( ramaiadsr/rssidue  cf  oases  plus  income) 
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n  will  have  at  the  end  or  u<i  *  »t age,  after  putting  in  the 
taginaing  of  this  stage  a  quunt^t.,  of  resources  x  ante  the  first 
branca  and  u  the  secondly,  ut  u  aase  functions  u-i.  the 

"functions  of  a  change  in  u«  resuurcss"  in  the  i  stage.  Let  us  note 
that  is  possible  any  cf  tns  ..  eiat*cns  nips/ ratios: 

l‘{x) ' 

(it  is  analogous  foro^vj). 

Page  39. 


let  us  consider  the  pca^e  a^ace,  which  corresponds  to  this  task 
(Pig.  11.1).  Such  space  win  a«  nc  longer  triangle  AOB  (as  in  the 
tasks  without  the  enclosure  of  *ncoass)  ,  out  entire  first  quadrant 
xoy  (resources  can  net  only  ce  *.euuc&4,  but  alsc  increase)  . 
Trajectory  as  before  consists  or  tne  ssnes/rew  of  ccmpcnents/links ; 
to  each  stage  (except  the  fusty  corresponds  the  pair  of  the 
components/ links:  the  first  -  "*«uistribut icn  of  resources",  when 
point  S  is  moved  in  parallel  AfJ.  tie  second  -  "expenditure  and  the 
acquisition  of  resources",  aurin*  whicn  point  S  car.  move  in  any 
direction.  In  contrast  tc  ac.  previous  examples,  here  obtaining  the 
"finaL  income"  of  w  is  ccz.uewt«a  only  with  one,  latter  itself, 
component/link  m2f  which  in  Fig.  11. i  ^s  isolated  with  heavy  arrow. 


In  this  case  the  value  wf  criterion  4  is  directly  evident  on  the 
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drawing  -  this  is  the  sta  or  anscxssa  and  ordinate  cf  point  SKna. 
corr asponding  to  final  state  s/sta*.  Tuu s,  the  task  of  optiaua 
control  can  be  formulated  sc;  to  swlact  mis  trajectory  of  point  in 
the  pnase  space  in  order  to  ueuac*  it  as  a  result  of  the  a  step/pitch 
for  straight  line  i„mi  /}„„„•  paia  liai  *3  and  distant  behind  the  origin  of 
coordinates  so  far,  as  iccn  «s  tn^>  will  oe  possibly.  The  value  of 
criterion  8  is  represented  <Ls  cue  segment,  intercepted/detached  for 
each  of  the  axes  of  straignc  ixs*  . 

let  us  construct  the  diagram  of  toe  solution  of  this  problem  by 
the  method  of  dynamic  programming  without  the  comprehensive 
varba  1/literary  explanations,  s.*no«  ;na  entity  of  method  is 
sufficiently  clear  from  previous,  uuciag  function  P,(x).  u'/y)  thus  far 
we  will  superimpose  cc  limitations. 


Fig.  11.1. 


Page  iO. 

1.  we  fix/record  issue  {a-l)-th  scep/pitch  {preserved  resource 
plus  income)  Z„_r  Ccnditicnax  o^txaua  control  -i)  -  that  with 

which  will  be  maximum  a  tota.  ^ua^tity  of  rescurcas  (tasic  means  of 
plus  return),  after  the  a  st*p/*itch 

(112) 

But,  taking  into  account  formulas  {11.1),  it  is  possible  to  write 

™m  - ,)  =  F„  (Xm)  4-  G„  —  xj. 

Conditional  optinui  contcox  on  a  step/pitch  will  be 

located  frca  condition 

l*4(4„-i)=  mnx  +  — .r^)).  (11.3) 

u<r«i 
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2.  He  fix/record  issue  40-^)  -tn  step/pitch  Zm-r  Ccnditional 
cptiaan  control  is  4.oua*u  rroa  tna  cccdition 

«(ZM.  i)=  max  ;tV',„(ip,_i(JC™-i)  + 

-+"  ^m-l  (Z/n-2  xm—  0  )j  <  *  * 

and  sj  forth. 

i.  He  fix/record  Z,_r  co^oa tiutai  optimum  control  is 

found  from  the  condition 

A'  i,  i  .  I,  .  .  Tt  ~ 

=  max  !  1^4.1 . n(^i(xi)~h  (^/-i  x())!  (*'  5) 

■’ 'i  - 1 

and  so  forth. 

4.  optimum  control  at  r^rst  otep/pirch  x*t  and  maxiaum  value  of 
priza  H  are  found  frca  ccnuawioa. 

a*=  \r*  i  ..  =  max  « . m(Pl(A-l)+G1(Z„-.x1))|. 

5.  Issue  of  the  first  during  the  cptimua  control: 

z;  =  /7.(.x;)  +  a,(£0---,O- 

optiaun  control  at  the  *ecinu  scap/pitch: 

x\  —  -vO- 


issue  of  the  second  st«r/p..tc^  wi in  the  optiaun  of  the  controls 
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y.\  -=  +  JC’) 

and  so  forth  to  tha  latter/ last  stop/p^tca. 

Page  il. 

2s  such  the  diagram  or  ;a4  soxucron  of  problem  by  the  method  of 
dynamic  programming  with  any  form  of  tae  function  of  a  change  in 
resources  F( (x).  G, (y).  However,  u  wo  oa  these  functions  superimpose 
some  (very  natural)  limitations,  taais  aiagram  can  be  highly 
simplified. 

Let  us  assume  that  ali  *  uncticns 

F,(jc).  0, (y)  *) 

are  tae  nondecreasing  functions  o^  taexr  arguments  (i.a.  that  with  an 
increase  in  the  quantity  ox  .nutauwd  resources  the  sum  cf  income  and 
remaining  resources  toward  tae  «uu  oc  the  stage  it  cannot  decrease) . 

Let  us  show  that  under  these  conditions  the  maximum  prize  at  the 
lattar/last  step/pitch  is  nou  deer  «aSi  ng  function  from  the  issue  of 
each  step/pitch  (sum  of  resources  xn  its  end/lead). 

let  us  consider  maximum  pciz*  wa«*n  the  sum  cf  resources 
(remainder/residue  plus  income)  at  tae  end  (i-1)  -th  stage  is  equal 
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to  Z^v  since  prize  is  acquired  *.u±j  xn  tna  latter/last  stage,  the 
nevertheless,  to  exaritc  tai^  roc  satire  process,  either  only 

for  tne  latter/last  sta<,e,  o*.  tor  ail  stages,  beginning  from  the 
i-th.  Let  us  select  the  latter:  will  examine  maximum  prize  for  all 

stages,  beginning  frcm  the  x-  tn  da  function  fees  Z,_r  designating  it, 
as  always 

W i+t . *  (Zi-i)* 

Let  us  demonstrate  that  this  fu»*o«.xoa  not  decreasing.  Proof  we  will 
conduct  by  full/tctal/ccmpxexe  induction,  but  net  frcm  i  to  i+i.  as 
this  is  done  usually,  but  on  tn«  contrary,  free  i  +  1  tc  i  (in 
accordance  with  the  "reverse"  couxse  or  tae  process  cf  dynamic 
programming) . 

Let  us  assume  that  tne  rcov«u  property  is  correct  for  i+i,  i.e., 
the  function 

W'/’xl . e  iZ,) 

is  the  nondecreasing  furctxou  or  .ts  argument  7,  (this  it  means:  the 
greater  the  resources,  suitc-in*  on  income  and  basic  means,  it  was 
preserved  to  the  issue  cf  tn«  i  step/pxten,  the  greater  there  will  be 
the  income  at  the  end) .  Let  us  demonstrate  that  then  by  nondecreasing 
function  it  will  be  anc 

W\,  ....  m(Z,-.». 


Page  i 2 
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Actually/really,  accordant  tw  iciiMula  (11.5),  /t,  ..  is  the 

maximum  of  the  expressicn 

»r'I  i . m{rl(yl)4~r‘,^i  (ii.6) 

Let  us  show  that  6 x pres*. ion  1 1 1.  t>)  is  ncr.decreasing  function 
/  >■  then  it  will  be  it  is  c^.e ar  raas  as  its  xaximus  value 
U"‘  ,  ,i _ „(/,.()  with  increase  '/. /-i  aeccease  canrct. 

Let  us  fix  seme  value  Z,.,.  let  far  this  value  Z , - 1  expression 

(11.6)  reach  maximum  in  xr  s^aal  to  .  *i _ ■»  (Zi-i)  during  the 

specific  control  (distribution  or  resources)  x‘.  Let  us  give  now  to 
value  /,_i  certain  pcsitiv*,  ^acuaae  i Zr  *as  formed  certain  surplus 
cf  resources,  which  we  can  a.£Uuutu  aetween  branches  I  and  II, 
after  increasing  a  quantity  ^r  *.es ourcas,  iabedded  either  in  cne  or 
in  another  branch,  or  irto  uat  <tua  aaotnar  ixne diately .  Since 
function  ^(jc).  o\  ty,  net  decreasing,  tae  from  this  "addition"  cf 
resources  each  of  the  ccapon® ats/teras/addends  under  the  sign  of 
function  (11.6)  can  crlj  oe  increased;  it  means,  and  their  sub  can 
cnly  be  increased,  but  net  suat*  less. 

4hat  in  this  case  will  be  with  function  (11.6)  ?  According  to 
assumption  these  are  -  tuotuca  la;  it  means,  and  with  increase 
it  be  reduced  cannot.  Thus,  *.r<»ns*tioa  fron  i  *  1  to  i  is  proved. 
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Get  us  show  now  that  oui  is  correct  for  i+1=m,  i.e., 

for  the  latter/last  step/pit-a.  dais  is  proven  very  simply.  Prize  at 
the  latter/last  step/pitch  uaciug  ths  optimum  control  is  the  maximum 
of  th  a  expression 

-t-  t  A  I'1 

and,  naturally,  to  eat  nonage. raa^Gg  function  from  ^.,,-1  (this 
recently  it  was  shown  for  ani  vaau*  of  i,  and  also,  therefore,  for 
i=m).  Thus,  u  is  n endec ceasing  function  and  means, 

according  to  the  principle  r ux^/total/co mp leta  induction,  and  any 
of  the  prizes  . .  i.  . 1)  -  noauocreasiag  function,  3  ED. 

Page  93. 

Prom  that  proved  escape/ an ^Ud  vac/  simple  race mmendatiens 
regarding  the  optimum  centra^.,  actuaily/csall y ,  if  final  prize  w'n  is 
nondecreasing  function  from  ue  total  sum  of  resources,  realized  on 
the  issue  of  each  step/pitcn,  iu«>u  optimum  control  lies  in  the  fact 
that  on  the  issue  of  each  s up/ti;cn  individually  tc  obtain  the 
maximum  value  of  this  sm  ot  csso ureas. 

This  means  that  in  this  special  case  the  "interests"  of 
operation  as  a  whole  ccinciuo  tna  "interests"  of  each  single 

step/pitch.  The  raticnal  pia«aiu*/  gliding  of  entire  operation  is 
reduced  to  optimize  each  ste^/pitwn  individually,  without  worrying 
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about  the  others. 

This  special  feat cra/pau uiia..ity  leads  to  the  fact  that  the 
process  of  producing  the  optimum  control  strccgly  is  simplified. 
Actually/really,  greater  ue.  e  no  necessity  to  fix/recocd  the 
results  cf  each  previous  ster/pj.<-ci.  aau  to  draw  entire  chain/network 
of  conditional  optimum  controls  Ubi  tna  latter/last  step/pitch 
towacl  the  first.  It  is  p  os>  sx  c  i.«  co  uirectly  optimize  step  by  step 
from  the  beginning  toward  u.  «cu.  At  the  first  step/pitch  to  take 
such  control  x1=x*t,  dcriay  wtiica  ns  converted  into  the  maximum  the 
sum  of  resources  Zt: 

Z|=  max  {fl(jc,)-|-O1(Z0-x1)|; 

0  <  x,  <  Z, 

cn  the  second  -  thg  cortxci  narrag  which  it  is  converted  into 

naximam  Z 2: 

Z*=  ma-’t  1^2  (*2)  -f-  Oj  (Z|  —  x’,)) 

o  <  Tj  <  z* 

and  so  forth  to  the  end/lead. 

Thus,  with  non  decreasing  ruuctions  g,(  y)  stated  by  us 

problem  of  the  exterior  cn-ty  tav»  tae  torm  of  task  of  dynamic 
programming,  and  actually  -  it  ju>  nucn  simpler  it. 

Similar  "degenerate"  ta^&s  or  tne  dynamic  programming  where  the 


optimum  control  lies  in  the  .ac.  rnac  to  optiiiza  each  etnane 
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without  worrying  about  the  other®,  frequently  they  are  encountered  in 
practice.  If,  without  having  xocu®«d  attention  cn  this  special 
feature/peculiarity,  tc  scive  cnen  navertheless  by  the  method  of 
dynamic  programming,  the  solution  it  gbas  without  saying  will  be 
obtained  accurate,  but  will  aaay  tiaes  Tore  time,  than  it  is 

necessary . 

Page  ^4. 

Let  us  do  one  additional  unservition.  At  first  glance  it  can 
seem  that  the  superimposed  auCin*  ruacticn  Ft(x),  Gt(y)  ccnditicn  -  so 
that  they  would  be  ncndimini® nin*  -  is  satisfied  in  all  in  practice 
concaivable  cases.  Hcwever,  it  *s  possible  to  give  the  practical 
tasks,  in  which  it  is  ret  iar lem*uteu.  Let  us  consider,  for  example, 
the  case,  when  cne  of  the  "oidacavs"  of  production  is  storage  of  the 
perishable  goods  (vegetables*  on  «.na  storage.  This  branch  yields  cnly 
the  losses,  connected  with  tue  nurses  of  gccds  during  their  storage. 
Let  us  designate  Ft(x)  <  x  tne  vasuo  of  commodities,  which  were  being 
stocked,  at  the  end  cf  the  t- tn  snags,  if  in  the  beginning  of  stage 
it  was  x.  Always  whether  tni®  unction  will  be  nonotona?  No,  not 
always.  It  is  possible  to  viniumw  suen  situation  when  with  the 
overload  of  storage  cf  icre  than  certain  critical  valua  function  F(x) 
begins  to  decrease  (fee  exaa^la,  a ue  to  deterioration  in  storage 
conditions).  In  similar  cas«®  is  accessary  to  solve  problem  the 
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overall  diagram  of  dynaaic  ^  ograminin  g  as  this  was  shown  above. 

o.  Let  us  consider  case  wn*n  into  production  as  bafore  is  packed 
entira  income,  but  criterion  •  *.»  net  income  in  o  stags  (preserved 
basic  means  are  not  ccr siaerta)  . 

net  be  preset  to  tte  "luccujt  of  income"  /;(*).  g,(y)  and  tc  the 
"function  of  expenditure"  ?,(*)•  ^(y)  for  each  stage  (1=1,  m)  . 

Let  us  show  tnat  if  function  gm(^)  ~  the  "function  cf 

inccma"  in  the  latter/last  soa>,«  -  not  decreasing,  then  task  is 
reduced  to  examined  in  pcint/it«*Uk  A,  namely  tc  the  maximization  of 
total  prize  (remaining  resource  ^us  income)  afterward  (m-1)  -th 
stage.  Actually/really,  ccnu^tionai  xaximum  prize  at  the  latter/last 
step/pitch  will  be 

■(  {  Z  ,n  _  i)  =  max  “I”  g  m  {7  tit  -  l  Ifn)  1  •  f  1 1  •  0 

It  is  possible  tc  demon*  crat*  (analogously  how  it  was  dcre  in 
point/item  a)  that  function  w‘m(7.m. 0  is  the  ncncecreasing  function  of 
its  argument,  and  its  maiimuw  lea-nes  wnen  7.n-\  j*t  reaches  its 


maximum  value.  Thus,  fcr  th*  d«t*i minatioa  cf  optimum  control  is 
sufficient  to  solve  task  "a"  tor  i^rst  m-1  steps/pitches  with  the 
functions  of  a  change  in  tn*  uaouicas 
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F;  (JC)  =  /,  (X)  +  5,  (.<). 

Qi(y)  —  + 

and  tnen  to  separately  iina  optimum  ccutr3l  on  the  a  step/pitch,  on 
the  basis  of  fortrula  (11.7). 

Faga  75. 

If  functions  p (x).  (7, (y)  (/  =  I . m  —  \)  Kill  also  be  acn decreasing , 

then  cask,  as  in  the  preceding  case,  it  Kill  prove  to  be  degenerate. 

If  functions /«(■*).  /r„(y)  *£*  act  *#naecreasing,  then  reducing  to 

task  "a"  becomes  already  lmpwssimto  and,  is  necessary  tc  resort  to 
the  overall  diagram  cf  cynaju-c  *.iogra  aaitg .  Tc  reader  one  should  as 
the  useful  exercise  sketch  uis  anagram. 

c.  Let  us  consider  cas«  Kata  income,  obtained  in  each  stage,  is 
packed  into  production  ret  completely,  but  partially,  moreover  is 
maximized  f  ull/total/cc  nplata  act  income  m  all  stages  plus 
remai.idar/resid ue  of  resources  ai.«r  m  stage. 

In  this  task,  as  it  tie  orimai/  tas*  the  distributions  cf 
resources/lif etimes,  mast  u«  pies«t  to  the  "function  of  income" 
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As  the  phase  space  lei  us  coualiec  no  longer  first  quadrant  xCy 
cf  plane,  but  first  octant  xOyi  or  tarae-dimensional  space  (fig. 

11.  2).  Along  the  axes  Cx  aru  Qi  aa  before  are  p letted/deposited  the 
resources,  which  are  lecateu  in  o*.anchas  I  anc  II;  along  the  axis  0:. 

-  totil  income,  yielded  ny  uw zu  o^anotias.  Region  S0  of  tha  initial 
states  of  system  -  as  tefoiw  a^ucbHisa  A3  cf  triangle  AOB  in  plane 
xOy.  All  stages,  except  the  lirat,  ace  suodividsd  into  two 
compoaents/links:  on  the  frr.»t  ccm*oaeat/iink  the  resources 
(preserved  in  both  tranches  ^lus  cue  specific  part  cf  the  income  of 
the  previous  stage)  are  reuio  ti-iuutei  oatween  tta  branches;  on  the 
second  co aponent/lin k  occurs  ta«  •xpsnditare  cf  resources  and  the 
acquisition  of  income,  fi  .  41.2  &uo ws  two  stages:  the  first  consists 
only  of  one  coapcnent/licx,  caw  »%cond  -  of  two. 


Page  16. 
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-et  us  consider  values  *!=?i(*i)<*i  y!=  ^(.v,)  <y,  -  the  resources, 
which  were  preserved  in  fcranoaos  tee  I  and  II  toward  the  end  first 
stage  where  xif  yt  -  cccrdinates  or  point  S0  -  resources,  imteddsd  in 
brand  I  and  II  during  tne  mss.  otaje;  5,  -=  y , (.v,> -f-  (y,)  -  income, 
brougat  by  both  branches  aum*  ta«>  first  stage.  During  the  first 
stage  point  S,  which  represents  ue  state  cf  system ,  shifts  from  the 
initial  state  S0  -  point  on  iiaw  «u  in  plane  xOy  with  the  coordinates 
(X|*  1 1 »  °)  ~  into  point  K  nta  tae  coordinates 

y;=t,(y,)<yr 
=  A  (*1)  +  K\  (Vi)- 

Then  on  the  first  component/.!,  m*  or  second  stage  (2,)  occurs  the 
enclosure  of  the  part  ct  tae  incwui*  ana  the  redistribution  of  the 
resources  between  branches  l  ana  n.  Point  S  is  moved  again  to  plane 
xOy  into  point  fl  with  the  cowrainates  (x2,  y2  ,  C)  ,  moreover 

further  again  goes  the  expenuirure  of  resources  and  the  acquisition 
cf  incone  (compcnent/lirJc  ,  uwi  again  redistribution,  etc. 

Jur  tast  -  of  deducing  font  o,  wuich  represents  the  state  of 


system,  cn  the  plane 
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with  the  highest  possible  vdi.ua  or  parameter  C. 

Let  us  sketch  the  dia^rui  Ui.  that  solution  cf  problem  by  the 
method  of  dynamic  programming 


j.et  us  note  first  cf  aii.,  tnat  if  is  f ixed/racordad  issue  (i-1) 
-th  stage,  then  for  the  fallowing  (tae  i-th)  is  essential  only  the 
total  sum  of  the  redist iibut»a  i.ascurcus 


and  taerefore  despite  the  tact  tnat  ud  state 
represented  as  point  ir  tae  whiaa-aijens ic nal 
valuas  only  of  one  parameter  Z,.i- 


cf  system 
space,  we 


was 

will  vary  the 


Fig.  11.2. 


Page  17. 

I 

"control"  on  the  i  stage  (jU.«c  as  in  the  previously  tasks  of 
iistributing  the  rascurces/i^io c-mes  examined)  will  consist  c£  the 
selection  of  value  xi  -  quantity  ci  resources,  imbedded  in  branch  I 
in  the  i  stage.  Prize  s  tor  ostua  process  naturally  is 
divid  ad/marked  off  into  a  or  ta«  component  s/ter ns/addends: 

W=^wl  -|-w,4-  ...  4-tr(n_l-f-;om.  (11.3) 

where  tv,  with  i-1,  2,  . ..,  a- 1  ai«  tae  net  income,  not  packed  into 
the  production: 

and  at  the  a  step/pitch  -  is  an_i.*  nee  income  from  the  m  step/pitch 
plus  the  remainder/residue  o*.  me  ..aoadded  resources: 


w  = :  -4-  .« '  — j—  v'  - 

m  m  '  m  '  J  >n 
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3tep  by  step  optimization  we  will  conduct  according  to  the 
standard  diagram. 

1.  Me  fix/record  value  Zm-i  ^rasarvad  resources  plus  packed 
part  of  income),  which  charau issue  (a —  1 )  -th  cf  step/pitch. 
Conditional  optimum  ccntroi  xm{7.m_ ,)  on  the  m  step/pitch  will  te 
located  from  the  ccnditlcn 

l*C(Z„,_i)=r  max  {«/,„!  = 

a<rm<zm-> 

=  max  \fm{xm)+f'm{Z„_x—xm)+. 

-4- Pm  (-^m)  +  '  ~  A‘m)|  ■ 

2.  Let  us  fix  issue  ot  (m-2)  -tn  of  step  In  order  tc  find 

conditional  optimum  ccntrcx  te-1)  -;h  step  x,n-i necessary  to 
maximiz a  with  the  given  one  Zm-i  sum  U^m-i.  .•«  of  the  following  values 

1)  the  remaining  (net  xmbauuju  in  tha  production)  income  at 
(ra-1)  -th  step 

^m-  I  f  m—\  (Xm  -  l)  “1“  Cm-  i  ^  m-1  X  m_  j) 

Rm- I  if  m- I  (xm-  0  +  .Cm-  1  n-7  —  xm-  )l 

2)  prize  at  the  la  t  ter/.*,  as  t  step/pitch  during  the  optimum 
control 

'V  m  -  I )  =  W,„  (?m  -  1  / Xm  -  I )  +  ’’’m  -  I  ^ m  - 2  ~  Xm  .  , )  + 

"4~  ^m-l  if  m- 1  (xm-  |)  +  Cm- 1  (^m-?  —  Vw-|)  )  )• 


Fage  98. 
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Thus,  conditional  optimum  control  on  (*-1)  -th  the  step/pitch  is 
located  as  the  value  at  •iu.cn  it  is  reached  the  maximum  ct  value 


-  I ,  rrtl^iti-2) —  max  (  W  tn  —  I,  m  (Ztit  -2*  X,w_|)|  — 

—  1  (4,-2  ~  — 

-  Hm  (*,„ -I>  +  Zm  (2, 4- 

+  U'’,  (?*-  ,(•*«,-»>  +  ~  •«,  _,)  + 

+  R, n-\ (/«-l  *„,_,)))). 


J.  Conditional  optimum  coutrox  Ar*(z,_i)  cn  the  i  stage  will  be 
located  from  the  relationsiiir/raCxo 

.  •  1 . .n(Zi- 0—  max  |/i (Jt{) -f  y (Z, —  .*,)  — 

a  <  JT;  <  Z,  _  , 

-  /?,  (/,  <  -V  4-  g,  (Z, _ ,  -  X,) )  4-  vr  f , . „  (f,  (*,)  + 

4-  w  ,  —  AT,)  4-  fit ( /( (-V,)  4- —  .t.) ) )| - 


4.  optimum  control  *'  a<.  atap/pitch  and  maximum  value  of 

priza  W*  are  found  from  condition 

11  . —  max  {/if  f,)  4- — -f,) 

"  -;.r,  ^  z, 

—  ff|(/|(-«.)  4-  . Cl  (Z,,—  .«,))  + 

W]  (?,  (A-,)  -r  V,  (/„  -  4-  /?,  {/,  (A,)  -4- 


i.  Issue  of  the  first  auric*  optimum  control 
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/;  --  ?,  <*;>  -  *,  <*„  -  -<)  l  nt  (/,  f-o  4 -  v  )• 

optimum  ccntrol  at  second  si«p/riidi: 

issue  of  second  step/pitch  optimum  control: 

z;  -  va4)  +  h  -  O  -  /?,  (/,  (x5-)  4-  gjz;  _  ^  )w 

and  so  forth  to  latter/lasr  dtar/(<»t:h. 

Page  99. 

4e  recommend  to  reader  is  j.nu«»pa  ad  ant  ly  sketch  tha  diagram  of 
the  solution  of  the  following  proojLems  of  distributing  the 
rasourc as/ lifetimes. 

1.  To  optimize  distribution  or  resources  according  to  tec 
trancaes  of  production  under  ror-towing  conditions:  income  is  packed 
into  production  net  cctpletery,  our  partially  ("function  of 

enclosure"  /?,($)  U  —  1 . m—  i)  are  *reset)  ;  is  Baxiaized  total  net 

incona  for  all  stages,  wituout  te^ng  into  account  remaining 
resources. 

a.  To  optimize  distribution  or  resources  according  to  two 
trancaes  of  production  under  following  conditio rs:  income  is  packed 
into  production  not  cc  b  j  lets.*,  y,  s*nca  its  known  fraction  *;  (5)  is 
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raaovid  in  the  feta  cf  tax;  *. eeaxuxng  part  is  packed  into  production; 
it  is  naxieized  total  quantify  ox  ;eio\iccus  (basic  plus  inccce)  after 
if  stage.  1  There  will  not  o«  auj  of  these  tasns  under  sene 

conditions  for  that  decener dw«ay 
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§  12.  Other  varieties  of  tne  tad*,  of  distributing  the 
resources/ lifeti aes. 

In  this  paragraph  we  uul  consider  several  tasks  of  the 
different  regions  cf  practice,  winch  uelcag,  actually,  to  the  same 
category  of  "tasks  for  the  UiStiinution  cl  the  resocrcas/lif etimes" , 
but  ia  which  unusual  setting  immea.*.atei/  dees  net  suggest  abcut  the 
familiar  diagram.  Calculating,  tnac  c ha  leader  already  seized  the 
principles  of  dynamic  { i cgiam aj.ng ,  we  will  allow  ourselves  with  the 
solution  cf  these  problems  c*.  storing  oack  from  standard  notation, 
after  preserving  by  ccnstant/  uvai.aala  only  the  diagram  of  the 
solution. 

a.  Task  about  weight  au-, emtution  between  steps/stages  cf  space 
vehicle.  One  must  plan  multilevel  *pace  vehicle  in  the  limits  of  the 
specific  launching  weight  c.  Coseonau t' s  cahin  has  preset  weight  r.v 
It  is  assumed  that  the  icciet  have  m  of  steps/stages. 

Page  100. 

Launcaing  weight  of  rocket  composed  or  the  weights  of  all 
steps/stages  and  cabin: 
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til- 

o  —  21  0,  4-  g*. 

I  ■=  1 

where  •'#,  -  weight  of  the  i  s«.ep/staga. 

Sach  step/stage  has  sjae  su^pxy  of  combustible.  g^fter  fuel 
daplacion  used-up  stage  it  u^caCi  il  and  it  enters  in  the 
operation  following. 

Additional  velocity  it\.  ■  aict  acguxres  the  rocket  for  the 
operating  time  of  the  ergiae  or  u«  r  step/stage,  depends  both  on  the 
waight  of  step/stage  itselr  (<j«u.ng  uetermining  the  fuel 
reserve)  and  on  the  weicnt  or  tuat  cargo  which  it  is  necessary  to 
carry: 

^Vi  =  f(Gr  PJ.  (12.1) 

whera  o  ^  ^ 

n=G,n  +  Gu  j-j-  ...  +  Gm  +  gK  (12.2) 

-  weight  cf  the  "passive"  ca^go,  moved  ay  the  i  stage  of  rocket. 

2±  is  necessary  to  tina  aavauta^eous  weight  distribution 
—  —  between  ■  stages  c*.  rcc*ot,  vita  which  the  velocity  after 

the  lisch arge/br eak  cf  all  ste^o/atag es  will  he  maximum. 

Task  is  similar  tc  cn«  .t  ua  versions  of  the  task  of 
distributing  the  resources/ lifetimes,  namely  -  tha  task  of  the 
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redunlancy  of  the  rasocrcas  §  1J,  p.  b)  .  Actually/ re  ally ,  m  of 

the  stages  of  rocket  it  as  to  visualize  as  n  of  the  stages 

cf  tha  process  of  acceleration.  oerora  each  stage  we  rust  solve:  what 
part  jf  being  at  our  disposa*  weiant,  uot  spent,  until  now,  we  is 
spent  to  this  stage,  and  unu».  ■«  ..oSurva  tor  the  following,  however, 
in  comparison  with  the  tas*  ot  tn*»  redundancy  cf  rascurces,  eiamined 
into  j  10,  this  task  has  certain  special  feature/peculiarity: 
function  f,  which  is  determining  ".acoie"  from  cae  stage  of 
accelaration,  it  depends  not  ca  one  argument  -  tha  "imbedded'1 
rasources,  but  frcm  twc  -  "imOauagu"  aid  "reserved".  However,  this 
does  not  vary  the  method  or  «.n«i  solution  and  even  it  dees  net 
complicate  it  any  substantia* 1/. 

Let  us  designate  u>  -  w«ignt,  separated  to  tha  i-th  step/stage 
("control"  in  the  i  stage);  Q, —  G, -j- </2 -f  n,)  —  weight,  reserved 
to  tha  remaining  ste ps/sta* «t> .  i/a*ue  Qi  is  analogous  to  the  sum  of 
resources  that  remains  at  our  a*sposai  after  tha  i  stage  in  the 
task  about  the  redundancy  or  resources. 
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In  the  new  desi  anatious  rouiaia  (12.1)  can  oa  rewritten  thus: 

*vi  —  /  (G,.  Q,  -f  gK).  (12.3) 

Phase  space,  just  as  in  ta«  tas*  aoout  tne  redundancy  of  resources, 
can  bj  assigned  in  the  fcrw  u:  ciianjia  AO B  (Fig.  12.1).  In  each 
stags  the  trajectory  reaches  tn«  axis  of  the  ordinates  (the 
"resources" ,  isolated  into  tae  ster/stage,  completely  are 
expea  led/consumed)  .  Then  s0  ±. les/ioSt s  on  line  PE,  feint  S*0H  -  in  the 
beginning  cf  coordinates. 

..et  us  begin,  as  always,  uoi  the  iatter/last  stage.  Any  weight 
Qm-r  which  was  preserved  as  *  of  the  previous  stages,  should 

be  it  goes  without  saying  co* y  returned  cn  m-th  step/stage. 
Conditional  optimum  ccntrcx  at  t iie  a  s»ep/pitch  will  te 

=  Q„_i* 

In  this  case  will  ta  taa  conditional  taiiirus  velocity 

increment,  which  ccrresjcaas  to  ^.vea  one  Qm- v 

Ck)- 

4e  fix/record  weignt  <?*-:•  wiiioh  canained  aftarwari  (m-2)  -th  of 
stage.  It  is  cbvicus, 

Qm-l  —  —  Gw-i- 
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Conditional  cptimuii  ccntux  ou  {a  -  1)  -  stay*  (}'„ . ,  (r4,_:)  will  be 
locatad  as  rotating  into  tae  laxidui  tae  suit  cf  two  velocity 
increaents:  achie ved/toacata  ia  (a-1)  -th  the  stage  with 

contra!  and  >■  -  nax^aui  i^ueiod  ia  tfce  m  stage: 


— max 

0  <0rn-y  ^^m-i 


1/(0,-..  Qm-,-a«'-l  +  eK)  + 

"I-  A^,„  - ;)] 


and  sa  on. 
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Conditional  optioua  ccn«.iox  cl  cue  i  step/pitch  is  found  from 
the  condition 

^i,  /  ll . — 


max 


Qi-t  —  ai  +  eK)+ 

+^;+. . -(<?«., -Oi)i- 


After  the  optimization  or  roe  frc;t  step/pitch  (selection  of  the 
weight  of  first  stage  G*t)  roe  s**ueace  of  stages,  as  always,  passes 
for  a  second  tine  from  the  o«gi£u»xug  toward  the  end;  as  a  result  is 
found  the  set  of  the  optiaua  uea^nts  of  the  steps/stages: 


<v  o;. 


<C  %<K-<c 


the  imparting  to  the  useful  .»ta^/stage  (cabin)  taxisua  speed 
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a.  Distribution  cf  weapons  or  dastructicn  according  to  defended 
targets.  In  those  tasks  dist*  muttons  or  the  resour ces/liteti «es 
which  were  encountered  tc  as.  now.  the  resources,  isolated  in 

any  stage,  or  gave  inccie  aau  uue  to  tuis  were  expended  (in  full  or 
in  part),  or  they  were  reserved,  cue y  did  not  give  incoee.  but  were 
not  expended. 

Here  we  will  ccrsidec  uw  peculiar  task  in  which  the  resources 
are  expended  not  only  in  tuac  sta*«  where  they  give  "incoee",  but 
also  in  those  stages  where  t*ey  ".icai."  do  net  yield,  intensity  of 
the  expenditure  cf  these  resources  depending  on  that,  was  how  euch 
iabeddad  in  this  stage  cf  tne  axractiy  functioning  resources. 
Discussion  deals  with  the  aiatciouii:>n  of  rescurces/lif etiees  with 
the  "autual  support".  As  an  exatpae  we  will  consider  the  task  about 
the  distribution  of  the  resources  of  striking  the  defended  targets. 

Cask  is  placed  with  foi^owm*  Banner:  is  planned/glided  the 
coabat  interaction  by  the  sp«ciric  weapons  of  destruction  (for 
exaaple.  aircraft,  rocket.  w*ngea  eissiies)  on  soee  defended  targets 
(for  exaaple,  ships,  tie  an Ct-air craf t  guns,  etc.),  largets  are 
distributed  in  depth  ic  the  uapta  of  territory  on  several  parallel 
borders  of  defense  (Fic.  In.n). 
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iefore  to  leave  tc  thrs  oora«r.  weapons  cf  destruction  pass  zone 
the  operaticns  weapons  cf  tius  no*. uec  where  the;  undergo  bcstardaent 
£roa  the  side  of  the  latter,  weapons  of  each  border  can  conduct 
fire/light  not  cnl;  acccrdxu*  to  toe  weapons  cf  destruction,  which 
are  guided  directly  fcx  targets  or  tais  border,  hut  alsc  on  those 
weapons  of  destructicn  which  pa *.a  through  the  zcne  cf  action,  being 
direcced  to  the  sore  distant  targets,  arranged/located  on  the 
following  borders. 
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00000000000 

(_!)Uejtu  3-x  ptjdeotca 


99999999 
( 3)  lic/uj  2-30  pi/teMo 


7WK***  fcu  cm  dps  ozttedbtx  rfcdcmd  Z-io  putteotca 


oaaaaoaaa 

(<4)  Ue/iu  l-io  pyfe*ca 


1  i  1  i  !■  I  i  J 

(fo)Cpedcm3o  nopajKtmjo 


Pig.  12.2. 


Key:  (1).  Targets  of  tbt  Jr  a  boruar.  (2).  Zcne  of  action  veapcns  of 
3rd  border.  (3).  Targets  ci  ..nu  oordar.  (3a).  Zcne  cf  action  weapons 
of  2ni  border.  (4).  Targets  or  1*»t  border.  (5).  Zone  cf  acticn 
weapons  of  1st  border.  (6).  Weapons  of  destruction. 
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the  coating  o£  weapons  of  abstraction  is  planned/glided  as 
follows:  they  are  divided  in*. o  tna  consecutive  "waves";  the  first 
wave  is  directed  to  the  taxgat  or  tha  1st  border*  the  second  -  on  the 
target  of  the  2nd  border*  *to.  i'na  first  wave  passes  through  the  zone 
of  action  weapons  of  the  1st  to*a«r,  it  bears  there  known  losses* 
after  which  the  regaining  weapons  of  destruction  attack  the  targets 
c£  tha  1st  border*  as  a  result  or  which  sone  f racticn/pcrticn  of 
these  targets  is  surprised*  ana  tnsir  weapons  go  out  of  order.  Thus* 
after  the  coating  of  the  fxtat  wave  the  1st  border  cf  defense  proves 
to  be  partially  suppressed.  *hen  autars  in  the  operation  the  second 
wave;  it  eoves  through  the  zona  or  action  of  the  partially  suppressed 
weapons  of  the  1st  border,  losas  cne  tnera  certain  part  of  its 
composition*  then  it  enters  *nto  tae  zone  of  action  weapons  of  the 
2nd  border,  again  loses  thera  cactain  part  cf  it3  ccnpositicn;  the 
regaining  weapons  cf  destruction  attac*  the  targets  cf  the  2nd 
border*  etc. 

The  task  of  planning  tna  coating  is  posed  as  fellows: 

to  distribute  the  avaiiaOia  waapons  of  destruction  on  the  waves 
so  as  to  turn  into  the  tauiua  avarage/aean  nuater  cf  the  affected 
targets  on  all  borders. 
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The  posed  problem  ty  aatoi*  i.'kUBds  of  already  faailiar  as  the 
task  of  distributing  tie  resources/ lifetimes  ("  rescurces/lif etiaes" 
are  hare  weapons  cf  destructx.cn,  op  "income"  -  affected  targets),  but 
it  differs  froa  it  in  teras  wf  two  special  features/peculiarities. 

First,  the  weapons  cf  custr action,  isolated  for  the  interaction 
cn  the  targets  of  one  cr  the  ctoer  border,  not  only  iapleaent  their 
priaal  problem  (strike  targets),  out  also  they  prcject/eaerge  as  the 
'•support"  to  the  following  w«v*s,  tacilitating  for  thea  the 
overcoming  the  preliairary  roueis  of  defense. 

In  the  second  place,  ra  contrast  to  all  these  it  is  previously 
examined,  this  task  contains  to*  axement  of  randoaness. 
Actually/really,  an  actual  nuao«>r  cf  affected  targets  and  failing 
weapons  of  destruction  can  prove  to  oe  the  fact,  etc.  in  the 
dependence  on  the  randca  factor*  410c  example,  detection  range,  the 
accuracy  of  shooting,  the  r«u.lu£e»  of  eguipaert,  etc.). 

Page  105. 


The  tasks  of  the  dynaaic  p4.Oyiaaa1.ag,  which  contain  the  randoa 


factors  (the  so-called  "stochastic"  tasks)  fora  special  class  and 
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enquire  t he  special  approaca  (smm  *  15,  16).  However,  in  this  case  we 
will  not  use  this  general/co* mou/«.otai  approach,  but  solve  task 
approximately  with  the  help  w r  ia«  simplest  method,  frequently  used 
in  the  sisilar  cases:  «e  wilx  is pxaca  all  figuring  in  the  task  randca 
variaales  (number  of  attccieu  targets  on  each  border,  number  failing 
weapons  of  destruction)  wire  then  avecage/mean  values  (mathematical 
expectations).  This  method,  <oica  strongly  sicplifies  task,  usually 
gives  comparatively  small  erects  *a  tne  case  when  a  number  of  the 
combat  units  (targets,  weapons  or  ues tr ucticn) ,  which  participate  in 
the  process,  is  sufficiently  great  ». 

footnote  >.  An  example  c£  tn«  tns*. ,  decided  net  according  to  the 
"average/mean"  characteristics,  cut  with  the  real  account  to 
randomness,  is  given  into  3  i  0.  tai; footnote. 

The  solution  of  stated  ^roui.m  of  distributing  the  veapens  of 
destructicn  according  tc  tne  deisuued  targets  simpler  will  censider 
based  on  specific  example,  aster  assigning  the  specific  form  cf  the 
figuring  in  it  functicral  ae^eaaeuces. 

Let  be  planned/glided  coating  n  of  aircraft  on  the  air  defense 
weepons  (the  anti-aircreft  guns),  arc auged/ located  cn  a  borders  (Fig. 
12.  1)  . 
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In  all  on  n  borders  th*r  a  or.  b/  h  of  the  instruments 

m 

N=%Nt.  02:4) 

( » I  . 

where  'vi  *  number  cf  instruments,  ac ranged/lccated  on  the  i  border. 

At  our  disposal  there  <u.  e  u  jf  the  aircraft  free  which  aust 
be  formed  with  ■  of  the  wava*: 

/»=  £««•  02.5) 

where  *i  (i=1,  2,  ....  a)  -  a  number  of  aircraft,  which  fora  part  of 
the  i  wave  and  which  have  tn«  cciiuat  mission  to  influence  on  the 
instruments  of  the  i  herder. 

It  is  assumed  that  the  ara  iorned/shaped  and  is  obtained 

the  combat  aissicn  previous!,,  ,  amu  in  the  process  of  coating  no 
longer  they  are  reccestr  ucteu .  mca  wave  flies  before  those  following 
with  certain  prevent ion/aovauce  ua  the  time,  so  that  up  to  the 
nomenc/tocgue  of  the  ap^roacu  or  tae  following  wave  manages  to 
already  fulfill  its  ccmbat  mission. 

Page  105. 

deform  emerging  at  the  uoruw  of  tae  location  cf  instruments, 
each  aircraft  passes  tic  zoom  c z  action  of  the  instruments  of  this 
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tordar  where  it  undergoas  fio«baia*ent  iron  the  side  of  those 
instruments  of  this  border  muica  u«va  the  capability  to  shoot  (i.e. 
they  are  found  within  reacn  aau  u*<  to  the  given  aoaent/torgue  they 
are  not  affected).  To  attacx  to*  instruments,  arranged/ located  on 
this  oorder,  can  cnly  these  o.arcr«rt,  uhich  happily  passed  the  zone 
cf  the  operation  of  the  iosu  uiiui.  of  chxs  border  and  all  preceding. 
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Fig .  12«3i 


Kay:  (1).  the  4th  border,  N«  or  xi*stc uaents.  (2).  Zcne  of  effect  of 
instruments  of  4th  border,  (-»).  Border,  h3  cf  instruments.  (4). 
Zone  of  action  of  instrument-  or  otd  border.  (5).  2nd  border,  f»*  cf 
instruments.  (6),  1st  tcraer,  hx  ut  nutriments.  (7).  Zcne  of  action 
cf  instruments  of  1st  border,  to),  p  of  aircraft. 
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Characteristics  cf  the  •  ti.xca.ency  of  the  ccabat  action  of 
instr aments  on  the  aircraft  and  cue  aircraft  cn  the  instruments 
following. 

1.  Kill  probability  ex  wa*  aircraft,  which  flies  zcne  of  action 
cf  instruments  of  i  harder,  as  expressed  by  fcraula 

(12.6) 

where  Nt  -  average  nuatar  o..  instruments,  which  were  preserved  by 
those  nonafflicted  on  this  ccxaex,  *t  -  coefficient,  depending  cn 
efficiency  cf  shoctirg  cf  xn^txuaaats  at  aircraft. 

1.  Average  nuaber  cf  x.cu>txum«nt3  of  i  border,  fceaten  with  wave 
aircraft,  directed  alcrc  targets  ur  this  bccder,  is  expressed  by 
fcraula 

(12.7) 

where  JV,  -  nuaber  of  instxu*eat.s  on  i  border,  v,  -  average  nuaber 
cf  aircraft  in  i  wave,  whies  w*x«  ^rasarved  by  those  nonafflicted 
after  passage  of  rones  cf  action  wx  xnstruaents  of  this  border  and 
all  previous,  Pi  -  average/wean  axil  probability  cf  cne  instruaent 


DCC 


30  151506 


FACE  M9 


cf  border  by  its  attacking  a*rc edit. 

It  is  necessary  tc  assign  cue  composition  of  waves,  i.e., 
numbers  n1#  n2,  ...  n„  so  as  to  uacoiie  maximum  an  average  number  of 
affected  targets  on  all  borders; 

tti 

«r=2»,. 

i=  I  ' 

where  wl  -  average  number  o*.  enacted  targets  cf  the  i  border. 

In  order  to  use  the  awuoa  or  dynamic  programming,  it  is 
necessary  to,  first  cf  ail,  uivi u«  tae  plan ne d/glide  process  into  the 
steps/pitches  (stages)  .  This  disturbu  tion  can  te  made,  generally 
speaking,  by  different  *etnous;  as.  is  important  only  in  the  course  of 
reasonings  clear  to  visualize  «.m  aetsr  minaticn  of  "step/pitch 
accepted**  and  net  to  be  brou^at  uown  from  it  tc  another. 

<le  will  divide  process  into  *ne  sceps/pitches,  on  the  basis  of 
its  following  (it  can  be,  sufficiently  artificial)  schema tization. 

Page  103. 

Let  us  visualize  that  tfce  zo*s  or  action  of  the  instruments  cf  the  i 
border  approaches  certain  number  ui  aircraft  Z,_t.  which  happily 
surmounted  all  i  -  1  previous  coiners  of  the  defense  (this  number 
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7-i- 1  we  will  assuma/set  fly  U4  to  its  average/mean  value  and 

allow/assume,  thus,  net  only  *flci«s,  but  also  fractional  "quantities 
cf  aircraft").  It  is  necessary  ms  vaiua  -  existing  at  our  disposal 
cf  resource  -  to  divide  into  c*o  rarcs;  ■*.  -  the  aircraft,  which  are 

guided  for  the  damage/cefeat  c i  no  instruments  of  the  i  border,  and 
y,  =  Z, ~\~xi  -  aircraft,  "res&i.  v*u“  ior  ;n©  daaage/de feat  of  the 
instruments  of  the  subsequent  ooxaers.  The  first  will  meet 
nonwe jlcaned  fire/light  cf  tu»  instruments  of  the  i  ferder,  the  second 
-  wit  a  the  fire/light,  eireauy  wouiened  oy  previous  interaction 
cf  aircraft. 

Jpon  this  formulation  t i-rooiam  we  learn  in  it  the  already 
familiar  signs/criteria  of  tua  too*  about  the  redundancy  of 
resources. 

Let  us  plan  the  overall  diagram  of  its  solution  by  the  method  of 
dynamic  programming. 

1.  Be  fix/record  result  oi  im-1)  -th  of  step/pitch:  zone  of 
action  of  instruments  ct  a  ov,ru«r  appcoacaed  Z„_,  aircraft. 

It  is  obvious,  all  thes*  aircraft  must  be  directed  toward  the 
daaag  a/  iefeat  of  the  irstrua«nta  wi  tha  ■  border,  conditional  optimum 
control  at  the  m  step/piten  win  we 

x m  (12.3) 
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Let  us  determine  the  a^co^Aati  conditional  maximum  value  of  a 
number  of  affected  instruments  or  u  border  u  since  the  a 

border  yet  did  not  undergo  street,  on  it  were  preserved  all  -Vm  of 
the  instruments: 

.V„  =  ,V„.  (12.9) 

The  kill  probability  of  aacn  ox  on«  chosen  aircraft,  according  to 
formula  (12.6),  is  equal  to 

V  m  =  I  — 

and  an  average  number  of  ain.au  tah.cn  will  happily  cress  the  zone 
of  tha  operation  of  the  insc*.  uaera*  of  this  border,  it  sill  be 

1)  =  £„-|  •(<  —  Vm)  =  V  (12.10) 

Fage  109. 


According  to  formula  (1*.7j  rnese  aircraft  will  strike  the 
average  number  of  instruments  or  ue  a  border,  equal  to 

«>2"> 

where  7„,  as  shows  formula  (li.tw),  depends  or  7.m_v 

Thus,  on  the  m  step/prtca  are  found  conditional  optimum  control 
(12.8)  and  conditional  maximum  ^uze  (12.11). 
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2.  Por  planning/glidiay  (a-lj-ta  stap/pitch  we  fix/record 
results  (a-2)  -th.  let  the  zwo*  or  action  of  instruaents  (a-1)  -th 
cf  border  approach  ?m-7  axrc*azt;  xros  them  it  is  necessary  tc 
isolace  xm-\  on  target  (a-1;  -ta  uorier,  and  the  others  to  direct 
toward  the  a  border  thrcugu  zcae  of  actioc  cf  instruaents  of 
(m-1)  -th  border. 


Conditional  optiaun  ccuioi  will  be  located  free  the 

condition  of  aaxiaua  prize  a u  two  xactar/last  steps/pitches 


=  max 


(12.12) 


where  t)  -  average  ux  targets,  affected  on  (a-1)  -th 

border  by  those  isolated  for  ta**  *m-i  by  aircraft;  -  average 

number  of  aircraft  which  wx.Lt  «ri,*oach  the  zone  of  action  of  the 
instruaents  of  the  a  tcxder  uurxxi*  tais  ccntrcl  (this  value  it 
depends  both  cn  the  ccntccx  at  (m- 1)  -th  step  xi,-y  and  froa  the 
nuaber  of  aircraft  y«  =  ^«-2  —  ■*«-«•  isolated  intc  the  flight/span  of  the 
zone  of  operation  of  (z-1)  -ta  xioruar). 


According  to  foraula  (1^.7>  *«  save 


where 

(12.13) 

v  =  *  ,  (  I  —  1/  v*  ,£  ”  -  «  'V'n-  i . 

(12.1  1) 
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Let  us  ccunt  an  average  nurnoar  o f  nonafflicted  aircraft  cf  the 
second  ("reserved")  group,  pa&aros  turough  the  2one  of  action  of 
instnaents  of  ( ■—  1)  -tb  cr  uocu^i;  ia  order  tc  be  thrown  free  the 
m-th.  Upon  the  input  ictc  ia«  xcii«  of  chexr  operation  it  was 

Z-m-1 

An  average  nueber  of  instruaent*,  affected  cn  (e-1)  -th  border 
by  aircraft,  will  be  equally  to  deterxined  according  to 

foraula  (12.13);  conseauectii ,  co  i*-!)  ”th  the  border  will  be 
preserved  the  average  nuabtr  or  xnatr uaent s ,  equal  to 

•vw. ,  =  .V„-  (.rm- ,)■  (12.1 5) 

These  instruaents  by  tfceir  r^ra/x^yht  on  the  "flying"  Z„_2  — 
aircraft  decrease  their  nuao«r  cu  tha  average  tc  value 

-*«-,)  •r-<— .  (12.16) 

This  value  Z,„_|.  which  u«pen ad  on  Zm-7  and  aust  be 

substituted  into  foreula  (la-  1r>  and,  /arying  control  *„-i«  tc  find 
aaxiaua  conditicnal  prize  ^.,,,.(^,.-2)  and  corresponding  to  it  optiaua 
condi  cional  control  iz  ,) 

In  view  of  a  ccapaiatu.v«  coar-rexicy  of  the  figuring  in  the  task 
functions  hardly  has  tbc  seu<  to  attempt  tc  seek  aaxiaua 
analytically;  it  is  necessary  to  construct  the  series  of  the  curves 
cf  the  dependence  of  value 

1.  m  =  Qm I -I  (Xm-i)-{-Wm  (Z„_  1),  (1 2. 1  7) 
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of  that  standing  la  the  cucijf  or*c»a  u  eight  side  (12.12),  cf 
Each  curve  will  correspond  to  u«;  dataramed  and  on  it  will 

have  to  find  point  with  to*  ordinate.  ibe  abscissa  of  this 

point  will  be  conditicnal  br.i«ua  control  at  (e-1)  -th  stsp 
and  ordinate  -  correspond!! 9  t<-»  conditional  laxiaus  incoaa 
at  two  latter/ia*t  »t*rs/ patches. 

will  b*  further  cptiaii«u  i*-i)  -eh  stsp  etc. 


Fags  ill. 


i.  General  formulas  tor  couu-rtu  ml  aaxiaus  prize  'X'l .  .  „(Z,  .1) 

(and  respectively  condition**  uruau  control  x'lZ,. i»>  take  fern 

..I,  ....  !Q.  (*.)  +  'F'*  I.  ...  m  <Z,)|. 


0  <  'j  <  ^ 


i  t 


1 1 2.18) 


whera 


Q,(xt)  =*  ,vj  I  —  e~  *'  j .  (12  10) 

T(  =  jr /*VV».  (12.20) 

Z,  —  <Z,_,  — x^e"’4*1.  (12.21) 

/V,  =  ,V,.  -  (12.22) 


4.  According  to  general/ ccaao«/t oca 1  rale  the  process  of 
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optimization  continues  cigut  u*  to  taa  first  stap/pitch,  after  which 

is  sought  optiaus  ccntrcl  «t  e«cu  ntap/pitch: 

•  •  »• 

xi-  xi . ■*«' 

tiovsrar,  t ha  obtairad  aaiwMi  yat  arw  not  (with  exception  of 
rha  unknown  optiaua  cuafccrs  ut  >««as: 


since  thay  ara  foraad  taxing  into  account  tba  losses  cf  aircraft  on 
all  pretious  borders.  Is  crcur,  us^nj  V  tc  find  as  initial  nuabar 
cf  aircraft  in  i  wave  **.  u  is  Accessary  tc  adjoin  to  c*  tha 
atari je/aean  Loaaas  of  thx*  «av«  on  ail  pcatious  bordars. 

Lat  us  dasonstrata  tn*  ( cucauun  or  tha  cptisizaticn  of  control, 
aftar  assigning  tha  co cc ret*/ s^aC'txic /actual  nutarical  talues  of  the 
paraa  stars,  which  figure  in  ts*  i«*x. 

iuaber  of  bordars:  s*4. 

Nuabar  of  aircraft:  n*so. 

Nuabar  of  instruaenta  o,  to*  oocdura:  Nt*10;  n3»15;  N**10 

(in  all  Ml0a12»1S»10>«7)  . 

Kill  probabilitiaa  of  xoscxua«nt  uy  xts  cna  attacking  aircraft: 

/>,=0,4;  /»,  =  0.5;  /»,  =  0.4;  />,  -  1.0. 
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Characteristics  cf  t am  ncy  of  the  fira/light  of  air 

defease  weapons  on  the  aircraft: 

a,  =0.05;  1,  =  0.04;  aj  =  0.04.  j,  =  0.05. 

Page  112. 

ro  find  optisua  nuabers  or  aircraft  m  the  waves: 

nr  *;•  <• 

with  which  a  nuaber  of  affectea  iratcusents  or  all  holders  will  be 
aaxiaal. 

The  solution  we  will  construct  la  stages. 

1.  Conditional  cptiaiza».ica  or  fourtn  step/pitch.  Vie  are 
assigned  by  the  series/zow  o.  tre  values  of  a  nuaber  of  aircraft  Z3, 
which  approached  the  zone  or  action  of  the  instruaents  cf  the  4th 

border ,  for  exaaple: 

z3=  10  .  20.  30.  40  .  50. 

and  let  us  coapute  for  tbea  an  average  nuaber  of  struct  instruaents 
of  the  4th  border  according  rc  ro^auia  (12.11).  The  results  of 
calculation  let  us  design  iu  turn  turn  of  the  gr aph/diagraa  of 
dapendence  §**(23)  (Pig.  la.*).  an  tec  in  g  into  this  graph  with  any  Z3, 
we  will  be  able  tc  find  the  a p**o*riita  conditional  aaxiaua  prize 
h*«  (Z3)  ;  as  far  as  control  i»  concerned  conditional  optisua,  then  it 
is  sisply  equal 


X<(Zjs=Zy 
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2.  Conditional  cptiaiza*  ja.s  ox  caxrd  stap/pitcb.  de  are  assigned 
by  th  i  secies/row  of  the  vaxuaa  ox  nuaoer  Z2  cf  the  aircraft,  which 
suraounted  the  previous  two  uGiaux: 

Z.  =  10.  15.  20.  25.  30,  40. 

and  for  each  of  thea  let  us  count  rrisa  at  two  latter/last 
steps/pitches:  the  third  -  uurxng  any  control  and  tte  fourth  -  with 
the  optiaua: 


in.i  =  Q,('f3)4-^(Z3). 

(12.23) 

Z,  =  (Z.  —  xje-'X'-, 

(12.24) 

•V5--  .V ,  —  <2, (•«•»): 

<?.,(*,)  =  A/,  fl 

(12.25) 

whet9 
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'•  'J  3  jS  Zd  jo  ' ' 

Fig.  12.4. 


Page  113. 

Salue  Qj  (x,) ,  entering  ..n  (1a. 23),  is  counted  according  to 
foreuia  (12.25),  and  R*4(Zj)  is  xocated  through  the  gcaph/curve  Pig. 
12. 4,  Cor  which  it  is  necessary  co  eater  into  it  with  value  ct  Z,, 
undertaken  free  foreuia  (1a.a4>. 

After  producing  calcuxasions  according  tc  these  foraulas  Cor  the 
selected  values  of  Z2  are  ;&•  s*xa«s/ row  of  values  i](  we  ccnstruct 
the  series  of  curves  Ccx  fum-tica  ■+Jf,  uependinc  cn  x3  (Fig.  12.5). 
For  each  of  these  curves  w  .ot,  toint  with  the  eaxieus  ordinate.  The 
abscissa  of  this  pcint  -  ccn.us.oal  optima  control  x*j(Z2),  which 
corresponds  to  that  72#  muo.  .occudes  too  curve;  ordinate  -  the 
appropriate  ccnditioral  uria un  ***ze  **j*(Z2). 
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2e  construct  on  the  gra*  h  or  rig.  12.6  (cn  the  different  scales) 
two  carves:  dependence  h*^*(22)  *****  dependence  x*3(Z2).  The  probles 
cf  the  conditional  optiiizar^on  or  tna  third  step/pitch  is  sclved. 

j.  Conditional  cptiairat. iou  wi  e  icond  step/pitch.  Procedure  is 
completely  analogous  and  snc«n  in  tig.  12. 7  ard  12.8.  Pirst  is 
constructed  the  series  cl  curves  «^4(x2),  which  correspond  to  the 
different  values  of  Z,  (nu*r«r  or  aircraft,  which  approached  the  zone 
of  accion  of  the  instrcsents  or  tne  2nd  border): 

Z,=  10.  20.  30.  10.  50.  GO. 

depending  on  control  x2  at  me  second  step/pitch. 
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Pages  114-115. 


Calculations  are  ccnductfea  acoocdiuj  tc  the  formula 
wl  3.  <  =  <?7 (-«2)  +  Wl,  i  (Z2).  ( 1 2.26) 

vhe  ra 

Qt(x2)  —  N.t\\  —  (12.27) 

•'j=-V”,Vf.  (12.23) 

and  value  h*3^(Z2)  is  r€ncve«i/t<i.*«ii  iron  the  graph  cf  Pig.  12.6  with 

<?j  =  (Z,  —  ,t7)  (12.29) 

,V,  =  /V7  —  (12.30) 

For  each  cf  plotted  curves  (*ig.  1*.7)  again  is  located  the  taxieua, 
and  ace  constructed  the  aelJ<iuii*.ic«a  of  its  abscissa  (conditional 
optieun  control  at  the  secouu  sc»*/pitcn)  and  its  ordinate 
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(corresponding  prize)  cs  i  Pi  g.  12.  8). 

Jraphing  of  Fig.  12.8  solvaa  tha  task  cf  the  conditional 
optiaization  of  the  seccnd  st Sp/pAtca. 

4.  optiaization  cf  first;  sre^/pxtcn.  Value  Zor  with  which  we 
arrived  at  the  optiwizaticj,  ar«  ^rasec: 

Zu  /«  ^  80. 

therefore  we  oust  const  evict  usi/  uue  curve  dependence  of  on 

central  xt  at  the  first  step/ px  ecu  (Fig.  12.9). 


Calculations  for  the  cjuiuucujii  uy  this  curve  are  conducted 
according  to  the  forvula 

wt 1f  <(xx)  =  Q,  (x,)  +  wl  x  .(*,).  (>2.31) 


where 


DCC  =  90151506 
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but  value  w  ( z  j )  is  i € bc /6u /taiai<  frjm  the  graph  cf  Pig.  12.8  with 

•  r 

Z,=(Z0  —  *,)«—*.  (12.34; 

/V,  —  iV,  —  Q,  (.r,).  (12.35) 

Z0  =  n  —  80. 

In  the  curve  o£  Pig.  12.9  we  note  ^ornt  with  the  maximum  ordinate  and 
thus  ^e  find  a  maximally  posaioiw  t-nze  (average  nuvber  of  affected 
instruments  tc  all  four  bcraecsj 

W'=  14.1 

and  optimum  control  cn  the  step/pitch 

x\  «  34. 

5.  Optimization  cf  entjua  process,  «e  find  optimum  control  step 
by  step  from  the  beginring  to  t a«  cnd/iead.  He  isolated  into  the 
composition  of  the  first  wave  (to  the  damage/defeat  of  the 
instruments  of  the  1st  tcrae*)  =  aircraft,  and  the  others 

y* t=80- 34=46  aircraft  directed  -further. 


The  zone  of  action  cf  ut  mstru  meats  cf  the  2nd  border  kill 
approach  (see  fcriula  (Iw.juj)  tne  nuaoer  of  aircraft,  equal  to 


where 


Z*  =  46* 

,v; = /v,  -  q,  (.o . 


Q,  (-O  =  -V,  [  I  —  e 


v‘  =  .V1V-""V'  . 


(12.36) 

(12.37) 

(12.38) 
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Producing  calculations  witn  a4=0.05,  Nj-10,  be  have 

Q,  (-0  =  5.6;  Z\  =  37. 

i.e.,  on  the  1st  border  it  w.,  lx  am  affected  cc  the  average  of  5^6 
instrumants,  and  the  zcce  or  action  of  the  instruments  of  the  2nd 
border  it  will  approach  cn  tu<  av^age  of  3 ~i  aircraft  of  46  "that 
reser vel". 

Page  117. 


2ith  the  obtained  value  ex  r*;=37  let  us  enter  into  the  graph  of 
Fig.  12.8  and  will  find  optimum  control  on  the  second  step/pitch 

i.e.,  from  37  preserved  airc*art  *t  is  necessary  to  isolate  23  to  the 
damag a/iefeat  of  the  instruments  or  tne  2nd  tcrdar,  and  "to  reserve" 

y\  =  37  —  23  —  14. 

«(e  further  find  a  cuao«x  or  aircraft  which  will  approach  the 
zone  of  action  of  the  iostrumants  of  tne  3rd  border: 


where 


z;-u« -•**». 

(12.39) 

Ni  =  Nj  —  <?2  (jcj)' 

r  7*  I 

(12.40) 

Qj(-cj)  =  Wj[l  —  e  /v,r’|. 

(12.41) 

V*  ss  JC*#**»^*. 

* —  *2* 

(12.42) 
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Producing  calculations  acccru^ng  to  these  formulas,  let  us  find 
an  average  number  cf  instluaoac*,  neatan  cn  the  2nd  border: 

«,(«,■)  =5.4. 

and  an  average  number  of  a^tocart,  vucu  surmounted  the  first  two 
borders: 

Zj  —  10.7. 

with  value  of  Z*2=10.7  We  oncer  into  the  graph  cf  Fig.  12.6  and  find 
optimum  control  cn  the  tfcira  ste^/fitcn 

*;=o. 

i.e.,  to  the  damaga/def eat  c*  cn*  instruments  of  the  3rd  border  of 
aircraft  to  select  ccmplet«i.i  necessary  !  This  at  first  glance 

unexpected  conclusion  will  Dm  ccafuetaly  natural,  if  one  considers 
that  the  shooting  at  the  inseminates  of  the  4th  border  under 
conditions  of  our  task  aucn  more  eificaent  than  on  the  instruments  of 
the  3rd  border  (^3-0.4;  p«s1j,  an u  therefore  has  sense,  in  spite  cf 
the  counteraction  of  the  3ru  ooru «r ,  to  reserve  ail  10.7  aircraft  for 
the  fourth  wave. 

from  these  10.7  aircram  tao  zona  of  action  of  the  instruments 
of  the  4th  border  it  will  a^roacu  on  the  average 

z]  =  z\  •  «-”'v  =  5.9. 
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Page  113. 

All  of  these  5,9  aircrart  must  a  a  oast  tc  the  da aage/def eat  of 
the  instruaents  of  the  4th  ct.r.i«r.  Fiji  thea  they  will  be  preserved 

by  those  nonafflicted  cc  tn«  average 

'• _ /.  -■•.v.  (') 

—  4i*  —  3,0  cawcMeia, 

Key:  ( 1)  .  aircraft. 


and  taey  will  strike  cr  the  <*tu  oerdar  on  the  average 


Q\  =  <V, 


opyaun. 


Kay:  (1).  instruaent. 


The  process  of 
control: 


optimization  *s  (.depleted:  is 

*;**  34;  a-j  =  23;  .v;  =  0:  x\  =  5.0. 


found  the  cptiaua 


It  reaains  to  pass  tree  uwa«  vaiies  (quantity  of  aircraft, 
separated  to  this  border  free  a  number  of  these  preserving  tc  this 
border)  to  values  "I-  n'Y  «j-  «*■  *ocxuued  in  the  waves,  f oraed/shaped  in 
the  beginning  of  coating.  «e  nave 

«;re.v;=34, 

i.e.,  in  the  first  wave  it  ia  necessary  to  include/connect  34 
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aircraft  of  80. 

Cn  what  proportion  it  is  ii«c«ssiry  to  divide  the  remaining  46 
aircraft  between  the  seccnu  «nu  rourth  waves?  According  to  out 
calculations  after  the  passage  or  rha  1st  border  of  46  "reserved” 
aircraft  it  will  remain  37,  or  «si«*  2  3  must  function  cn  the 
instruments  of  the  2nd  tcrae^..  axuce,  according  to  condition,  we  oust 
fora/ shape  waves  previously,  cut  not  on  tne  herders  cf  borders,  then 
it  is  obvious,  it  is  necessary  to  uivii*  46  the  "reserved"  aircraft 
betwean  second  and  foerth  waves  i *t  relationship/ratic  23:14,  i.e.,  to 
inclu ie/ccnnect  in  the  secouu  wav«  27  aircraft,  but  in  the  fourth  - 
remaining  19. 

fhus, 

ft*  -n  34;  /t‘=r2T;  /t*  —  0:  n’  =19. 

during  this  optiaca  pa a-msg/g lidiay  will  fca  affected  the 
oaxieally  possible  average  naaa«r  of  targets,  equal  to 

vr=  14.!. 

froa  oottoa  on  1st  berder  j.o,  au  *ni  5,4,  on  3rd  not  one  and  on  4th 


It  does  not  represent  u«  worn  to  count  also  its  own  losses  of 
aircraft  with  the  execution  or  tam  coaoat  aissicn.  The  part  cf  these 
losses,  namely  losses  in  tne  "css-rvad"  aircraft,  we  already  computed 
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in  th i  coarse  of  confutation,  xua  roc  tuea  it  is  necessary  tc 
supplement  still  less  ic  tao»a  aircraft  which,  favorably  after 
passing  the  preceded  fcciaazs,  a««  reaiu  to  the  damage/def eat  of  the 
instruments  of  this  berder.  «a  av„raga  quantity  of  these  losses  n« 
on  tha  i  border  is  ccmputeu  rrout  tne  formula 

ni=*;(i-,-vv/). 

Page  111. 


Applying  this  fcrscla,  ana  oiaO  taking  ictc  account  the 
previously  obtained  lesses  i*>  tow  reserved  aircraft,  we  will  obtain 
grand  average  lesses: 

on  the  1st  border 

13.4-4-9.1  =22.5; 

on  the  2nd  berder 

S.8  +  3.3  =  12.1; 

on  the  3rd  berder 

4.8; 

on  the  4th  border 

2.3. 

Altogether  of  80  aircraft  with  tu.  fulrillnent  of  operation  cn  the 
suppression  of  air  defense  iwoa  i«.  wilx  be  lost  in  a verage/ne an  42; 
by  the  price  of  such  their  own  can  be  achieved/reached  maximum 

"priza"  -  it  is  affected  cu  to*  av»raga  or  14  in3truaents  of  the 


DOC  *  801*51506 


FJU.E 


*4  9/f 


opponent. 


It  is  obvious,  such  uucw slutting  or  result  does  sake  it 
necessary  to  he  plannee  abou*  taat,  u  is  expedient  tc  generally 
carry  out  operation  cn  the  sup*.tb«sion  or  the  such  veil  defended 
targets  as  in  our  exaaple,  w*tn  tee  help  of  such  weapons  of 
lestricticn  as  the  examined  u  aircraft?  However,  reasonings  on 
this  these  exceed  the  scope  wc  ca*  ou jbet/sub  ;ect  of  dynasic 
prograasing,  especially  necausu  laatial  nuserical  data,  on  which  we 
constructed  the  solution,  we*e  s«Aecteu  ires  the  purely  systenatic 
consilerations  and  have  ac«.iu.ng  iu  coason  with  the  real  ones. 

-et  us  pause  at  ere  aci«  *ub.»ci3a.  Stated  problem  about  the 
distribution  of  weapons  ct  obstruction  we  solve  on  the  assumption 
that  the  distribution  of  airuiait  into  the  waves  and  output  of  the 
combat  mission  to  each  wave  *s  ,uuucau  previously,  and  in  the  course 
of  executing  the  operation  its  original  plan  does  net  vary. 

Page  123. 

In  the  principle  tie  ausitu  can  oe  assigned  otherwise:  to 
assume  that  on  the  appicacae*  tc  ««cn  border  the  actually  preserved 
number  of  aircraft  (which  in  tn«  accuracy  cannot  be  previously 
predicted)  each  time  cptiaaliy  redistributed  to  twe  groups:  one  is 
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directed  to  damage/defeat  or  tn«  cat  jet 3  of  this  border,  and  another 
flies  further.  In  the  presence  ci  the  nigh  speed  control  computer 
this  optima  redistribution  .3  jiuit  possible.  The  exact  solution  of 
this  task  can  be  constructed  uiui  the  general  methods  of  the  solution 
stochastic  problems  cf  the  u*  ras-ic  programing  (see  §§  15,  16). 
However,  in  the  first  approximation,  it  is  possible  tc  use  the 
following  method. 

In  the  beginning  cf  coa^in^  (on  overcoairgs  of  the  1st  terder) 
is  solved  the  task  of  dynamic  pio^raaming  as  this  was  shown  above, 
and  is  located  the  optima  ccniioa.  on  tae  first  3tep/pitch  x*t  which 
is  realized.  Then  is  discovered  tuat  tue  2nd  herder  it  approached 
actually  not  Z*t  aircraft,  nut  another  number  Z,.  But  indeed  with  the 

solution  cf  the  problem  of  a4  namic  programming  we  fer  eacn  Z,  found 

the  conditional  optimum  ccauoa  we  will  use  this  dependence 

and  lat  us  use  for  that  actually  carrying  out  Zt  this  optimum 
control,  etc. 

Logically  does  arise  t am  a  amotion;  does  have  sense  to  study  in 
the  course  of  operaticn  by  un>  '•* edisorib uticn",  i.e.,  is  great  the 
prize  in  an  average  number  o*  directed  instruments,  bought  tc  the 

price  of  this  complication  c.  ccn«.rol?  Hespcnse/answer  tc  this 

question  can  be  given,  only  if  mt  consccuct  the  aoce  exact 
"stocaa3tic  model"  of  ccabat  operations  (witheut  the  replacement  of 
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random  values  by  their  iatn»« at.cai  expectations)  ,  similar  this  is 
done  into  §§  15,  16. 

c.  The  saae  probles  wit..  anc&aer  criterion.  During  the  solution 
of  tha  previous  task  (b)  we  a£sua«u  that  the  target  cf  the  operation, 
carried  out  by  aircraft,  c axi  one  aaa age/defeat  of  targets 
(instruments),  the  greater  i«.  be  defended  affected  tnese 

instruments,  the  better.  Cnaax^OM  w  we  have  an  average  number  of 
affected  targets. 

It  is  possible  to  consiu ar  auotaar  task  when  n  of  aircraft 
surmount  air  defense  zcte  in  c rue*.  ba/oad  its  limits  to  fulfill  seme 
ether,  basic  combat  missica  *  for  exampiu,  bombing  on  the  industrial 
objects) .  in  erder  to  ensure  a  aanmalu./  successful  fulfillment  of 
this  oasic  combat  task,  ana  *s  selected  certain  guantity  of  aircraft 
for  tae  suppression  cf  air  a« f*nsa  waapons. 

Eage  121. 

As  the  criterion  during  tee  evaluation  cf  efficiency  in  the 
antic*  operation  in  this  cas*  ic  is  wise  to  select  an  net  average 
number  of  affected  instruments,  nut  an  average  cumter  of  aircraft 
7m'  surmounted  all  m  bciders  or  PvO  and  ready  to  execution  further 
combat  operatiens: 
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This  task  has  something  j«a«*.al/C3 amon/tctal  with  the  task  about 
the  distributions  of  re£Quic»s/.iXi.*tiaas,  when  is  maximized  not 
incoma,  but  the  total  qtantiwy  ox  resources  (see  §  lilt),  and  just  as 
that,  proves  to  be  the  "da^uicaw"  «.*»<  of  dynamic  programming. 

Actually/reall y  in  or  am*,  to  um  joavuced  of  this,  let  us  sketch 
the  diagram  of  the  scluticn  vi  rro<jlam  oy  the  sethod  of  dynaeic 
prcgraaaing.  The  criterion,  ■  aiun  xt  is  necessary  tc  turn  into  the 
maximum,  exists  *'  =  4  -  an  av^ait  uuan«r  cf  aircraft,  happily 

surmounted  all  m  borders. 

1.  He  fix/record  zm-v  c*  nu .4, clonal  o^tiauB 
stap/pitch  no  lcngar  «gua-».  to  Zm~i-  but 

condition 

K  Um.,)=  max  \2miZm.t.  xj\. 

vhera  xn)  -  average  &uiuu'  of  aircraft,  which  surmounted  the  a 

border  with  the  preset  tuauw.  ox  aircraft  2„.,.  which  enter  tc  this 
border,  and  control  xm  cn  00 rdar. 

Completely  it  is  clear  *c*t  is  ac n deer easi ng  function  Z„_,. 
therefore,  and  V/\  is  alsc  nwn  awe*,  waging  function  z„_,. 


control  at  a 

it  is  found  from  the 
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2.  Me  fix/record  Zn-i-  opiiaue  ccntrcl  on  (n-l)-th 

step  will  be  lccaitu  u^h  cad  condition 

w'„.K„{Zn.7)=  max  \\v’,n  (Z,n.l(Zm  _2.  xm_ ,))}. 

0  <  r/n  -  i  4i  -  7 

where  Z„-,  [Zn_2.  -  average  number  oi  aircraft,  which  surncunted 

the  first  »-l  borders  during  preset  '4.-2  and  fixed/recorded  ccntrcl 
v^-i  £t  is  clear  that  ftncuwo^.,-i(4-j'  •^-t)  is  the  ncndecreasing 
function  cf  argument  Zm.v  cc4.i**u«i.tly,  and  \v'„(zm . ,  (Z„.j.  *■,))  there  is 
non  deer  easing  function  Z,„_2.  auu  ciiis  add  ns,  and  -2)  —  the  alsc 

nondecreasing  function. 
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3.  By  completely  analogous  method  let  us  ascet  tain  that  for  an 
(i-th)  step/pitch  prize  at  a.l  ismuiaiuj  steps/pitches  tc  eat, 
non  decreasing  function  ct  Lu.ti«i'  oi  aircraft  Z,_ which  approached 
this  oorder. 

dence  deducible  is  the  ooncxusiotu  the  posed  problem  is  the 
"deganerate"  task  of  dynamic  prcy^amaiag.  tc  plan  is  nacessary  each 
step/oitch  separately,  d istx^bu nha  flown  up  to  this  border 
aircraft  to  two  parts  -  "to  uw  succession  of  air  defense  weapons 
and  "w  the  flight/span  fuctsei"  so  as  no  fceccae  mazimuo  an  average 
number  of  aircraft,  whicn  siu  mounted  to  is  border  (irrespectively  of 
the  others)  . 

§  13.  Distribution  of  resouiwes/iuietiaes  with  the  aftereffect. 

Examined  in  §  12  tesxs  ut  u^scriDutiag  the  rescurces/lif etimes 
were  characterized  by  ttat  sreciau  feacure/peculiar  ity,  that  the 
means,  isolated  in  one  "hranwh",  ^iojacted/emercad  as  the  "support" 


for  means,  isolated  in  acctn»r,  user easing  the  yielded  by  them 
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iacoiaj.  This  support  was  a>&a^.£«s'bau  to  quickly  after  the  enclosure  cf 
the  corresponding  means. 

In  practice  can  be  net  auca  jituacicns,  when  activity  of  the 
"supporting"  branch  is  aanii«stta  non  right  after  enclosure  in  all 
means,  but  after  sene  c tan city  01  stages.  In  general  an  increase  in 
the  income  of  "basic"  tranen  ue^c^us  ca  chat,  hew  leng  passed  from 
the  momant/torque  of  the  auc.cstkn  of  means  intc  the  "supporting" 
branch. 

rho  tasks  of  this  type  oavs,  cn  comparison  with  those  previously 
examined,  certain  feature:  ©^pomcioa  from  the  "basic"  branch  in  this 
stage  depends  not  only  cn  cat  scace  of  s/sten  at  the  given 
momen c/torgue  (where  hew  mcu  is  Ambeua  aa)  ,  but  alsc  from  the 
prehistory  of  the  ccntrcllta  process  (where,  when  and  hew  much  were 
investei  means).  The  preseuc®  cr  tois  "aftereffect"  (effect  cf  the 
past  on  the  future)  generally  complicates  the  process  of  planning. 

darlier  has  already  be«u  uiseussbi  cue  fact  that  the  presence  of 
aftereffect  it  is  possible  tu  manage,  including  in  the  prasent  state 
of  system  those  parameters  t~om  past,  which  essential  fer  the 
futur  a. 


Page  123 
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la  this  case  increases  the  uuaiuoi  of  measurements  of  phase  space  and, 
therefore,  sharply  grows  a  ^adu<.)  of  versions  of  the  states  which 
must  ee  sorted  out  in  tie  ^luce^i  of  optimization.  However, 
fundamental  difficulties  tula  solution  does  net  contain. 

Get  us  consider  a  specific  example  or  task  for  the  distribution 
cf  neans  with  the  aftereffect.. 

Is  planned/glided  the  w^r*  or  enterprise  with  the  initial  supply 
of  neans  Z„  forward  fer  period  a  or  years.  A  cuantity  of  neans  x, 
imbed in  the  enterprise,  *s  cuu verted  in  a  year  (taxing  irto 
account  of  income  and  expend.,  cure  cf  moans)  irtc  scire  another 
quantity  of  means  F*m(x),  whicu  cuu  re  i ess,  it  is  equal  cr  more  than 
initial  x. 

The  aeans,  available  in  ca*.  beginning  of  each  year,  we  can  at 
cur  discretion  either  ccspleiel^  racx  into  the  production  or 
partially  expend/consune  cn  *.h«  auxiliary  actions,  for  example  to  the 
content  of  scientific  labcra*oi^,  whicu,  conducting  research  cf 
production  process,  after  contain  rime  after  its  organization  raises 
the  profitableness  of  production,  m  consequence  of  which  the 
function  cf  a  change  in  meaiia  f*0)(x)  is  substituted  by  another: 
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F"'(x)>Ft0)(x). 

whera  k  -  quantity  of  years,  waxen  the  laboratory  already 

existed. 

function  F*k){x)  wito  ■xl1  k  ■«  wx ii  consider  nondecreasing. 

on  the  content  of  labctato..  j ,  oovxously,  it  is  necessary  to 
expend  some  means.  Let  us  assume  tnac  these  means  -  completely 
determined  (they  do  net  depend  u  our  warm)  and  are  equal  to  at  ( k.—  1  > 
on  th  i  '<  year  of  the  existenwa  ex  xaooratory  (after  it  it  worked 
already  k-1  years).  In  this  case  a  (0)  radicates  the  original 
expenditures,  required  fer  u«  creation  or  latcratory  and  its  content 
into  course  of  the  first  yea*. 

set  us  agree  to  ccnsiae..  ua>.  if  luring  seme  year  cf  means  to 
the  laboratory  they  are  act  ^axsasad,  taaa  it  is  preserved,  achieved 
profitableness  level  of  ficauctxoa  is  retained,  but  with  the  new 
enclosure  of  means  labciatotj  t unctions  and  raises  the  profitableness 
of  production  in  the  manner  chat  *i  interruption  in  the  financing 
they  was  not. 
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"Control”  of  the  cisti iu ut-.ua  of  means  on  eacn  stap/pitch 
(before  beginning  aach  tet  Lj.sc<u  jear*  does  corsist  of  the  solution 
of  tha  question:  tampering  «.c  c ha  laboratory  or  net  to  release? 

With  this  simplified  f  or  miua*.  ig*.  wi  cask  at  each  step/pitch  is  a 
selection  on^y  between  two  o^cecr^cas: 

O"'1  -  not  to  release  «edk>, 

U''1-  to  release  aeand> . 

It  is  necessary  tc  finu  cnis>  control  during  m  years,  with  which 
the  total  quantity  of  neans,  act  *mb«d4ea  in  the  laboratory  (the  net 
iacoma  plus  the  remaining  c  u  tha  oasic  means),  toward  the  end  of 
the  period  will  be  maximal. 

We  will  solve  stated  preum.***  cy  tue  method  of  dynamic 
programming,  It  is  first  or  «ix  n«cessary  tc  solve  the  question:  by 
what  parameters  we  will  characterize  tie  state  of  system  afterward 
(i=1)  -th  of  step/pitch  (before  oeginning  the  i  fiscal  year)? 

Is  obvious,  by  one  value  -  0/  a  guantity  cf  means,  which 

are  at  our  disposal  afterwaru  (-.-!>  -tu  or  step/pitch,  it  is 
impossible  to  be  bridged,  sx^c*  u«  mcome,  which  we  will  obtain  at 
the  i  step/pitch,  depends  no*,  uu^  on  what  quantity  of  means  we  had 
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available  in  the  beginning  Oi.  and  wnat  ccntrol  Mas  used,  but 

also  from  that,  how  nary  y*sa*s,  a- til  now,  worked  the  laboratory 
(with  our  assumptions  ne  ver  t*.  saws  -  worked  it  continuously  or  with 
the  interruptions). 

It  is  necessary  to  chart*  ctori-te  tue  state  c£  system  after 
step/pitch  to  twc  parameters.: 

-  a  quantity  cf  isaa^  (oasic  plus  income),  available 
afterward  ( i—  1)  -th  step/pj.tcn, 

■'■.-I  -  number  of  the  yearn,  uucrny  which  functioned  the 
laboratory  before  begircia*  .at  a  ntap/pitcb . 

The  state  of  systee  .S'..,  afterward  ( i—  1 )  -th  step  let  us 
register  in  the  form  cf  vector  «utn  two  components: 

1-  . — 1 1* 

is  the  phase  space  let  ns  consider  on  plane  ZOk  (Fig.  13.1)  the 
series/row  of  straight/cixec*. 

1  —  1';  2-2'; 

parallel  to  axis  abscissas;  o curates  of  these  straight  lines  are 
equal  to  the  integers:  C,  1,  a, :.  along  tne  axis  of  abscissas  are 
plcttsd/deposited  the  distributee  neans  Z,  alcng  the  axis  of 
ordinates  -  number  of  yearn  jt  tn«  existence  cf  laboratory  k. 
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Initial  state  of  system  -  co«  pj.ot.ory  datei  minatioa  point  s0  cn  axis 
0 Z  with  abscissa  Z0  (iratia-r  gaaurrty  jf  means)  .  If  at  this  step 
caan3  to  the  laboratory  are  .Ob  rereasad,  point  on  tfce  phase  plane 
moves  on  the  horizontal;  n  aeons  to  tae  laboratory  are  released, 
point  is  moved  with  this  hoc-zontar  iiae  to  the  following  in  order. 

iejion  s.„„  of  the  tanar  states  of  system  is  entire  the  phase 
spaca  (set,  straight  lires  d-d',  1-1',  etc.).  Prize  W=aZm  is  nothing 
else  jut  the  abscissa  of  la cter/raot  point  in  the  trajectory  The 

task  of  optimum  planri  r.c/grioan  ,  a*  ceauced  tc  deduce  the  point, 
which  represents  the  state  or  secern,  into  final  state  SK01I  with  the 
greatest  abscissa  (crdirate  aoos  not  have  a  value). 

-et  us  plan  the  diagram  or  corns  tr  ucrtion  of  optimum  control 
by  th  i  method  of  dynamic  proa  tanuarng.  .at  us  represent  gain  \V  —  Zm 
into  form  of  sum  m  of  the  co-pouents/tarms/addends: 

W  =  ...  +wm_,  +  Win, 

from  which  all,  except  the  ratter,  ace  egual  tc  zarc.  He  will 
ccnstract  the  solution  by  ta«  ota*uard  diagram. 
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Fig.  13.1. 

Page  126. 

1.  we  fix/record  result  (a-1>  -cn  step/pitch,  i.e. ,  two  numbers: 
quantity  cf  means  7-n- 1  ana  au )£  years  *.n-p  during  which 
already  worked  laboratory,  a*,  ocv.ous,  0  < <  m  —  l.  Let  us  consider 
and  let  us  compare  inccie  at  tan  a  step/pitch  which  we  will  obtain 
durinj  control  (/”  (if  we  uo  not  roliase  money  to  the  laboratory)  and 
during  control  u{,)  (if  reioasoi .  Ia  first  the  case  in  the 
production  will  be  iibeadea  alx  moans  and  we  will  obtain  the 

income 

woU— {/"")=  r'*"-') (*„.,)■  (i3.i) 

In  tha  second  case  in  the  production  will  be  imbedded  act  all  means, 
but  only  those  which  will  und.ii  altar  financing  of  laboratory,  and 
we  will  ottain  the  inccie 
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U'")  = /r<t«-->(Z,_ (13.2) 


since  function  n«t  usc^ easing,  tbsn  it  is  obvious,  of  two 

incoaas  (13.1)  and  (13. i)  tb»  i^it  is  always  mete.  Thus,  optimum 
central  at  the  latter/last  st et/extca  exists  u,m  -  net  tc  release 
means  to  the  labcratcry,  ana  control  does  not  depend  cn  issue 

(m- 1)  -th  of  the  steF/pitca 

o 

U'm  * 

but  the  corresponding  maximum  pns»  is  egual  to 

*».,)  =  (13.3) 

2.  Be  fix/record  issue  -ta  step/pitch,  i.e.,  vector 

s ?• 

During  control  (/"’  the  ^jiik  in  the  paase  space  will  pass  on  the 
horizontal  into  point  coordinates 

Z  .  =  /1‘»i-i)(7  ,y  *  — * 

'•“I  ,cm-l  —  *m~2- 

? rize  for  the  latter/xau»c  *«<,  steps/pitches  (during  the  optimum 
control  on  the  latter)  will  ue 


- 1,  m 


(Z,„ 


cr,  using  formula  (13.3), 


W-n- I.  m  (Zm  -  !•  £*,-!■  (7'°’)  - --  -  »)  (/■(*.*  ,)  ) 

(13.5) 
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Juring  ccntrcl  (/"  the  ^uiut  ±u  t  aa  phase  space  will  aowe  with 
straight  line  k‘„.i  tc  .n.  i.cj.lowj.ng  in  order  straight  line  and 

will  hit  point  Sm_t  with  tat  ccci.ui.na  tas 

*«-i*  *«-*+'-  03-6) 

In  this  case  „  it  •i^.a  c»  aacerained  by  the  fcraula 

(/")  =  Am_,)  = 

=  'xrm(F(k>*-t)(zm_2  —  a(ft„_2>).  A„_2-j-|),  (13.7) 

cr,  taking  into  account  (1j.j), 

a,.,.  (/")- 

=  -«(*„_*))).  (13.8) 

Jptimu*  control  ((/”  oc  (/")  «<*ai  ue  located  by  comparison  of  two 
expressions  (13.5)  and  (13. a,  acu  wita  tae  selection  of  maxiaum  of 
then 
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,  in  - 1 

i.  * i-i»  = 

| 

.  »(z, 

=  iU.1  X  | 

i 

1W\'.2...... 

U  ‘").  i 

u  ")  I 


.  ( 1:1.9) 


where 

W  I,  ,  +  i . Iti- 1.  u  )  = 

=  . ,1  *,.|).  (13.101 

w  . ,,  (z,  - 1 .  /c * .  i .  u  )  — 

=  u/’(1 . „ > (*j  ..))•  fcj.i  -i-  0-  (13 m 

U7 
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4.  optimization  of  fxrst  ste^/pitch  xs  prcducad  at  fixed  value 
cf  Z9  and  ko»0: 


where 


IV'*  =  'V'*  z  =  max 


UP  it  a „ (Z„.  0.  (/n’).  { 

r,t* . „(z,o.^)f'(13-,2> 


W  >t  7.  •  ■  ■  ■  -  (z*  0-  U")  =  (r"" (Z„).  0).  (1.1.13) 

ft'C: . m{U  0.  (/")  = 

=  w*.  ...  —  3(0)).  I).  (13.14) 


Optimum  control  u\  at  u«  step/pitch  will  u'n>  (drcp 

means),  if  expressicr  (13.U/  mu ra  :naa  (13.14).  if  cn  the 

contrary,  then  optimum  centrum  uu  (/“»  (release  means  »)  . 


FCCTNJTE  v,  yf  expressions  <u.  a  w^ual,  then  tcth  controls  are  equal 
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5.  Further  is  located  luso^i  w£  first  step/pitch  during  cptimui 
control:  (z*.  ftl);-  than  optimum  costicl  at  second  step/pitch  ui-  and  so 
ca,  up  to  latter/last  step/ tea. 

Let  us  demonstrate  the  ^Ciunon  or  problem  based  on  numerical 
example. 


with  J^<k^3: 


and  iwt  us 

assign  function  F'k)(x)  and  a(k) 

/=•«»(*)=  1.5.t; 

« (0)  =  1 : 

r"»(jc)=  !.6x; 

*0)  =  0.5; 

F'2'  (jc)  =  2.t: 

*(2)  =  0.4; 

F(1*  (x)  =  3jc; 

a  (3)  =  0,3. 

step/*,  l  to  a. 

as  it  is  already  explained. 

Um  =  U',=  U'°\ 

i.e.  means  to  laboratory  to  xereas*  not  necessary.  Curing  this 
optimum  control  the  pri2e  at  tne  ruurtn  step/pitch  fer  different  k 
will  ne  equal  to 

»'!(*!.  0)=  1 .57,; 

!)=1.6Z,; 

2)  =  2/,; 

«MZj.  3)  =  3Z,. 
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2.  He  optiaize  thira  st*»  p/ ri.tch.  4e  aave 

Wi *,(Zi.  0.  U'nr)=W\(\.'iZi.  0)  =  2.25Z}; 

«(Zj.  0.  U'")=W\{\.:UZ,-  !).  |)  = 

=  1.6(1 ,5Zj  —  1 .5)  =  2. 1Z?  —  21. 

of  these  twc  expression.*  „um  *irst  large  of  the  second  with 

Z2<16;  when  Z2>16  -  vice  veto  a.  inwrefore 

.  ( 2. 252’,  i • > np«*  Z,<16. 

Wy4(Z.7-  °)  =  (2 .4^ —  2.4  aJnprt  Zs>l6  (",) 

Key:  (1)  .  with. 


and  respectively 


U,{Zi.  0)  = 


Kay :  ( 1 ) .  with. 


£/<n’ ^npH  Z7  •'  16. 
U,l)  ^  npii  Z2>  16. 


(13.16) 


Further  we  have 

1.  (/")  =  < (I.6Z2.  I )  =  1 .6  •  1 .6Zj  =  2.56Zj; 

«^3%(Z2.  I.  t/"’)=  ^(1.6(Zj-0.5);  2)  = 

=  2(1 ,6Z7  —  0.8)  =  3.2Z,  —  1.6. 

of  these  two  expressions  taw  rirst  will  be  acre  than  the  second 


with  Z2>2 • 5.  Therefore 


2.56Z,  i/*np»  Z?<2.5. 


W*«Z»  '  ^  ~  |  3.2Z7  —  1 .6  ^npii  Z7>2.5 


,,  <m7> 


Key  :  ( 1)  .  with. 


and  respectively 
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Page  130. 

To  assume/set  kz=3  ac  icajwi  usc^s sary,  since  for  two  first 
staps/pitches  system  carncc  &rriv«  to  straight/direct  3-3'. 

J.  Me  optimize  scccnd  s* a^/^itca.  its  have 

0,  i/0,)=  <<(!.5Z,,  0). 


DOC  =  30151507 


na 


or,  u^ing  formula  (13.5), 


WU,U*.  o.  U"'’)  = 

3.375Z,  v»)npn 
_  t.  c.  0  npn 

3.6Z,  —  2A  (i)npii 


!.5Z,  <  16. 

Z,  <  10  J  *  10.67. 

Z,  >10  10.67. 


(13.21) 


Key  :  ( 1)  .  with. 


It  is  analogous 

'^(Z,.  0.  IJ'")  =  ip'*  , (l .5 —  , ),  ,). 

or,  using  formula  (13.7), 

X'iy  0.  6'*")  = 

I  3.8  »Z,  —  3.34  npu  l.5,Z, 

I  0 

__  1  r.  c.  npu 

|  •  SZ,  —  »i . 4  0  npu 


-  I)  <2.5. 


<2  .3  -  2.67.  (13  22) 
Z,>2y  =  2,67. 


Kay  :  ( 1)  .  with. 


In  order  to  solve  a  gaa^ticu,  wuich  of  expressions  (13.  i  i)  or 
(13.22)  is  aore,  let  cs  construct  the  jraphs  cf  the  correspccding 
functions  (Fig.  13.2). 


iach  of  the  curves  wixx  s«  orokan  line,  comprised  of  twc 
straight  lines.  The  laxiaua  ut  ta«se  t<o  functicns  is  shown  in  Fig. 
13.2  oy  heavy  line.  Letters  > ' «uu  r/<  n  marked  the  curves, 

corresponding  tc  the  cauo^Ou.ii,  ccacrois.  Ercxen  line,  which 
represents  the  maximum  of  t  wu  luiiccijqj  (13.11)  and  (13.12),  current 

con  si  Jts  of  two  segments;  cxc.c*  r«.nc  .»as  an  abscissa,  equal  tc  u.u*. 
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Key  :  ( 1)  .  w ith . 


Further,  ,  ifn)  =  w'xt{iMZi-O.S).  2). 

or,  using  formula  (13.  S), 

r; t.  (/")  = 

I  6.  IZ,  —  3.2  npii  1 ,6Z(  —  0.3  <  1.2. 

=  t.  e.  npi(d)  Z,<  1.25.  (13.26) 

19.6Z,—  7.2  npii(9  2,  >1-25. 

Key:  (1)  .  with. 


2xpressions  (13.25)  and  (ij.xoj  a^o  represented  graphically  in  Fig. 
13.3.  The  maximum  of  twc  fu  ac  tica*  (13.25)  and  (13.26)  is  shewn  in 
Fig.  13,3  of  fatty/greasy  urox au  x^ne  jf  lines  whose  equation 


■l  1.  I  <  2, .  i  ) 


I'V, 


O'npii 


|  1  6Z,  —  7.2  0fipu  Z  ';.  1.31; 


1 13.27) 


Key:  ( 1 ) .  with. 


hence 


U\t/.x.  1)  = 


UM)  (*)  npii 
U'l)  ^npu 


2,  ;  1 .31; 

Z,  >  1.31. 


(13.28) 


Key :  ( 1 ) .  with. 


Do  assuae/set  k,-2  nc  iwager  ueoassary,  since  for  one  first 
step/ pitch  system  cannct  axi\. »«  x*.  str  iigat/dirset  2-2*. 
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4.  We  optiaize  first 

Page-isa 

(lta  Vavf 

W  x_  2t .1. « l Z>.  0-  1/"')  =  ■t'l.J.  iU-S^o.  0;- 

<-  or,  usinc  fcritiia  ilj.13), 

wu  j.4(z0.  o.  u>m) = 

)  5.06Z0  (l*npn  I.5Z„  <4.49. 

—  ^JT.  e.  (Jnp«  Z„  <  2.90.  (13.29) 

I  7.27Z,  —  6.4  (PnpH  Z0>2.93. 

Key:  ( 1)  .  with. 


It  is  analogous 

•s'r.vi. <fz0.  o.  (/")  =  u^: ,.,(i.5(z.,—  i).  n, 

or,  accordingly,  tc  fcrsuxa  ilJ.1V>, 

^lt2.3.4Z„.  0.  C/‘")  = 

6.14Z,,  —  6.14  (Uipn  1.5Z0 
==  e.  (!)  npH 

1 4.4Z„  —  2,16  (£)npw 

Key:  (1)  .  with. 


Expressions  (13.29)  and  (U.j0>  axe  represented  graphically  in  Pig. 

13.4.  Patty/greasy  of  lines  oao-n  tae  naxitui  cf  these  twc 

functions;  the  equation  cf  uis  i^ue 

V/'(Z»  =  'K ,(Z..)  = 

I  5.06Zo  ; ' 2 n p it 

i  1 4.4Z0  —  21 .6 (j/npii 


Z0  2.31. 
Z0>2.31. 


(13.31) 


—  1.5  <  1.31. 

Z„  <  1.37.  (13.30) 

Z0>  1.87. 


Key:  (1).  with 
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Fig.  13.4. 

Page  134. 


ience  optimum  ccntrcJ.  at  cue  rirss. 

.  ( U'0,Q|iipu  Z„<2.31, 

W*(2o)  =  ((;(o^npll  Z0>2.31. 

Key :  ( 1)  .  with. 


step/pitch 

(13.32) 


will  be 


Thus,  the  conditional  or  un^atiou  of  each  step/pitch  is  carried 

out . 


5.  let  us  find  net  cp;i*ja  ecu tcoi  in  all  four  years: 

u‘=(u\.  u].  u\.  (/I). 


Let  us  consider  twe  cases: 
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a)  Z0<  2. 3  1 ; 

»J)  Z0>2.  31. 

In  the  case  of  a)  cptiaaii  cdutin  at  tbe  first  stap/pitch  will 
be  ^/*=:£/,u,  on  the  first  yea  *  or  ma.us  to  tne  labcratcry  to  release  not 
necessary.  To  end  of  the  L.iat  jma*.  wa  will  have  number  of  the  aeans 

Z’=  1.5 Z0  <  3.47; 

in  this  case  **  =  0.  t.  c.  5*  =  (i.5Z0.  0). 

In  order  to  find  cptutu*  ocat^oi  on  second  ste p/pitch  {/*,  let  us 
turn  to  the  graph  of  Fig.  1  o.  c.  ^uCs  ^"  <  3.47  <;  4,4^  the  optimum 
control  again  is  ti(0>: 

u\ = ir°\ 

i.e.  on  the  second  year  of  souss  to  the  laboratory  to  release  not 
necessar  y . 


4e  find  the  result  of  toe  «<*oona  stap/pitch  during  tbe  cptiaua 
control : 


Z:  =  1 .5/!  =  2.25Z.,  <  5.20;  *j  =  0; 


Si  ■=  (2.25Z,|.  0). 
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?rom  formula  (13.6)  follow!  ccau  also  at  the  third  step/pitch 
the  optimum  control  exists  uu»  («ot  :j  release  xaans)  ,  since 

zj  <  5.20  <  16. 

Control  at  the  latter/i*.st  .»i»p/pxtcfi  is  standard:  to  release 
means  to  the  laboratory  is  not  necessary. 

Page  135. 

In  this  case  the  maximum  (S««  formula  (13.21))  will  be  equal  to 

^*  =  5.06Zo. 

Thus,  we  ascertained  Uut  an  initial  Quantity  of  means 

Z0< 2.  J 1  optimally  control  ojuscs 

LT=s(U(n,  Um.  (/'«*,  Ul0>). 

i.e.  laboratory  generally  started  must  not  be. 

Analogously  we  are  convene cd,  tame  with  Z0>2.3  1  the  optimum 
control  will  be 

cr=(uu).  uu).  uu).  ulo>). 

i.e.  laboratory  one  should  to  immediately,  and  to  last  year 

preserve.  In  this  case  lauiai  income  mill  be  equal  to 

I4,4Z0  —  21.6. 

Pig.  13.5  shows  two  optimum  <.t aj  actor  ies  in  the  phase  space  for 

two  concrete/specif ic/ ectuax  v*.*. u«s  of  Zu: 

Zn  =  2,2  <2.31  ti  Z0  =  2.4  >  2.31 . 

The  first  trajectory  ccrr  asto nuo  to  too  case  when  means  to  the 
laboratory  are  not  released;  ta.  *«coaa  -  tc  case  when  laboratory  is 
financed  in  any  stage,  except  tn«  ..actor  itself. 
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Let  us  note  that  in  our  saamt4.&  tae  optiuus  control,  depending 
cn  th  *  initial  supply  cf  s«<us  is  constructed  according  tc  the 

type  "all  or  nothing"  y  earner  wxto  i  sufficient  supply  of  scans  it 
is  necessary  always  (except  x&st  j*ac)  to  hold  laboratory,  or,  if  the 
supply  of  means  is  insufficient,  to  in  nc  way  start  it.  Here  not 
under  such  initial  condition^  tnexe  can  na  advantageous  at  first  to 
accumulate  aeans,  and  tc  taeu  ? ut  than  into  tte  laboratory. 

Phis  is  connected  fcitn  .a«  r«ct  cuat  we  considered  too  small  a 
number  of  steps/pitches  (®-=u*  .  xt  xs  possible  tc  prepese  to  reader 
this  exercise:  to  supplement  our  xuitial  data,  i.e.  ,  to  assign 
function  FU)  (x).  F,s>(.v).  ...  ana  a*^«ndituras/cc  nsum  ptiens  a  (4)  ,  a(5). 
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...,  in d  to  attempt  to  obtain  iucu  solution  during  which  optimum 
control  will  be  "mixed";  at  u«  initial  steps/pitches  the  means  to 
the  laboratory  are  not  relea^ea,  a*.d  taea  this  becomes  advantageous. 

§  14.  Tasks  of  dynamic  pco^raiLm^.n^  wtta  the  ncnadditiva  criterion. 

All  tasks  of  the  dynamic  pxc3iamming  which  we  examined,  until 
now,  they  belonged  tc  tte  jusa  ci  tae  "additive"  tasks,  i.e.,  such, 
in  which  it  is  maximized  (at  u  m^uimaradj  the  criterion  of  the  form 


tp—  v 


W;, 


(U.l) 


where  v,  -  the  "prize",  acjiucau  tarn  i  stage. 

Generally  the  method  of  uyuamxc  programming  can  be  used  also  to 
the  "aonadditive"  tasks,  in  w axca  thw  criterion  is  not  represented  in 
the  form  (14.1).  seme  cf  toes  aa.w  reduced  tc  by  the  additive  simple 
conversion  of  criterion. 

dere  we  will  consider  cue  simplest  form  cf  the  tasks,  which  are 
led  to  the  the  additive,  namely  task  with  the  multiplicative 
criterion . 


"Multiplicative"  we  wix*  caxa.  criterion  ("prize")  a,  if  it  can 
be  represented  in  the  fexa  c*  prouuct  cf  the  "prizss",  reached  in 
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the  single  stages: 


m 


(U.2) 


Page  137. 


Ct  is  obvious,  any  auii.  criterion  a  cf  fern  (14.2)  can 

be  artificially  converted  to  tne  auditive,  if  we  take  the  logarithm 
expression  ti; 

w  =  S  l*T  »i  (14.3) 

and  to  designate 

x>,.  =  l (14.4) 

We  will  obtain  the  new  ente*  io*. 

(14.5) 

i* » 

possessing  the  property  cx  dudiuvitj  ana  turning  into  the  maximum 
(minimum)  simultaneously  vita*  «• 

i.et  us  consider  twe  exa*»pits  of  tasks  with  the  multiplicative 
criterion . 


a.  Distribution  c  cf  piwject*aes  according  tc  ■  targets  which 
must  ne  struck  together,  lac  ta**«  be  at  our  disposal  by  n  of  the 
projectiles  by  which  we  visu  to  suxiae  ■  of  the  targets: 

U|<  UJ . Un.  («  <  ft). 

the  combat  mission  lies  in  t*.«  uui  tnat  to  strike  all  targets 
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without  the  excepticn/e  liame.  tic*.  Ic  is  accessary  so  tc  distribute  n 
cf  projectiles  cr  a  targets  »o  uac  ud  prctahility  of  the  combined 
damag  a/lefeat  of  all  targets  «  *oaj.d  reach  taxiaum. 

<1e  will  consider  the  ui.»tt  luutiou  oi  projetiles  as  m-  the  stage 
operation,  in  each  stace  01  ■  hn-a  occurs  the  extraction  of  certain 
number  of  projectiles  tc  tee  spac^xic  target.  Let  us  designate  ki  a 
number  of  projectiles,  iscidweu  iu to  tae  i-th  target  (i=1,  2,  ...» 

a).  Control  u  will  consist  o*  tie  selection  cf  the  rushers  kv  k- .  ft  . 

u  =  [kv  If- .  Itm).  (14  6) 

and  it  is  necessary  tc  seise,,  it  u^tiaaliy. 

„6t  us  assume  that  in  ud  r*oce  ss  or  the  t  c  a  tar  dir  ant  of  each 
target  arc  ex  pende  d/cc  r  s  uic>  u  au.  caoseu  into  it  projectiles  and  the 
redistribution  of  means  is  a«t  rrouuced.  Furthermore,  let  us  assume, 
that  the  discrete  targets  «u  su*.rciseu  by  the  chcsen  ct  then 
projectiles  independently  or  «aca  othar. 

Page  138. 

Then  «ill  probability  all  a  w> r  targets  is  equal  to  the  product  of  the 
hill  probabilities  cf  the  ui*cr«t«  targets: 

=  «U.7) 

where  Pt(k ()  -  hill  prctebixi^y  or  the  1  target  by  isolated  on  carried 


OOC  =  30151507 


by  projectiles. 

For  the  solution  c t  postil  t-rwslem  it  is  required  to  assign  the 
f  unct  ion 

Px\k).  P,(k .) . P„(k).  (14.3) 

characterizing  the  vulrirau^ir/  ui  targets  acd  expressing  kill 
protajility  by  each  cf  t tea  -.a^^saing  on  nufber  Jc  of  chosen  into  it 
Fro  jectiles. 


If  all  these  functions  are  identical: 

/»,<  *)  =  Pi  ('«)=•••  »?,(*)»?(*)• 

i.e.  the  vulnerability  cr  <u.  targets  some  and  the  same,  then  task 
becomes  trivial  and  is  r«aucaJ  co  distribute  prcjectilas  on  the 
targets  about  the  possibility  ««btiiy.  aut  if  targets  are  dissiailar 
by  th i  vulnerability,  obviously,  me  quantity  cf  projectiles, 
separated  on  the  basis  cb  t i ei>  vulnerable  targets,  must  be 
relatively  more. 

aefore  slinging  the  solution  ny  me  aethcd  of  dynamic 
programming,  let  us  ncte  so*a  or  ts  properties. 

Sach  of  the  functions  Pt(k).  u«co mas  zerc  kith  k  -0 ,  i.e.. 


Z7, (0)  =  0  1=1.  2, 
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therefore,  if  we  do  net  tic«,  at  i«a>t  one  cf  the  targets,  criterion 
w  will  beccae  zero,  hence  ro-kioas  the  condition 

At,  I  (/  =  1 .  2 . m). 

i.e.  on  each  target  it  is  a fet-essa*/  to  isolate  at  least  one 
projectile.  Furthermore,  projectiles  cn  the  basis  cf  the  i 

target,  we  aust  remeeeter  atwut  tae  tact  that  tc  these  remaining  m-i 
targets  it  is  necessary  witiiwut  lull  to  reserve  at  least  cn  cne 
projectile;  therefore  each  c*  it.*  values  .  ki  is  United  not  only  fron 
belcw,  but  also  cn  tep: 

I  At,  <  it  —  m  -r  I .  *  ( 14.9) 


Fage  139. 


In  order  to  use  the  nuuou  Oa.  dynamic  pregranning,  let  us  pass 
from  multiplicative  criteria-  (14.7)  to  tne  additive,  after  taking 
the  logarithm  it  with  ary  ta^ia/tase  (for  exasple,  natural  e) : 

m 

InW'^V  !„/>(*,).  (14.10) 

In  order  not  to  deal  coucaxi^ng  negative  numbers,  let  us 
designate 

] In UF- 1  =  V.  |1nP,(*,)|  =vi(kl)  (U.ll). 

and  we  will  obtain  the  raw  -  aou-tive  -  critericn 

(*«)• 


(14.12) 
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iince  we  changed  the  sijB  ox  criterion,  then  valua  V  it  is 
necessary  to  no  longer  tc  maAimu..&«>,  duo  to  xinimize. 


Thus,  tasks  it  is  reduced  to  t ha  foilowirg:  tc  find  contcol  u*. 
which  rotates  into  the  ainxa.ua  va^ue  (14.12). 


The  obtained  task  calis  to  uund  taat  exaained  into  §  10  task  of 
distributing  the  rescurces/i.tdt.wws  with  the  redundancy. 
Actuaily/really ,  available  n  ox  eject  lies  can  be  considered  as  the 
initial  means  which  intc  eacu  stuj®  if  operation  are  divided  into  two 
parts:  separated  and  reserveu,  moreover  the  separating  means  are 
expen ied/consumed  to  the  euu/ieau.  Taa  special  feat ure/peculiarit y  of 
thi3  task  j.n  the  fact  that,  .a  first  place,  number  cf  the  means, 

saparitad  in  each  stage,  can  nave  cniy  integer  values,  limited  by 
condition  (14.);  furthermore,  cne  "income"  cf  V  it  is  not  maximized, 
but  it  is  minimized. 


In  the  tasks  of  distributing  thw  resources/lif etimes  we,  for  the 
uniformity,  each  time  as  tue  paus a  space  examined  triangle  AOE  on 
plana  xOy.  Here  it  would  oe  possible  to  do  sc,  tut  ve  will  prefer 
ancthar,  more  demonstrative  metaou  ox  the  image  of  the  process  during 
which  directly  evidently  not  cnij  control,  but  also  the  obtained 
"prize". 
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Let  us  consider  as  phas..  ar«cts  the  sat  cf  tha  straight/c irect , 
parallel  to  axis  abscissas;  o-d*,  1-1',...,  n  —  n'  with  the  integral 
ordinates  (Fig.  14.1).  Ecint  s,  w*»ici  represents  the  state  of  system, 
will  oe  in  the  process  cl  tn«  cuatiiopujii  cf  projectiles  moved  with 
cne  of  these  straight  lines  .c  mother.  If  intc  this  target  is 
isolated  only  cne  projectile,  tum  point  S  Bill  be  movad  to  the 
adjacent  straight  line;  if  t»o  -  aia  Ramped  tbrcugh  the  straight 
line,  etc. 

Page  140. 

Thus,  along  the  axis  cf  crui*.at«»a  *i^i  be  plctt ca/d epcsited  the  spent 
to  this  stage  number  cf  .V  Alcng  tha  axis  of  abscissas 

we  will  plot/deposit  the  accumulated  for  several  stages  "prize"  £U(. 

Jbviously,  the  initial  atat*  of  system  S0  completely  tc 
deter ainaticn  coincides  sinc«  tr*  origin  of  the  coordinates;  region 
5««.  of  the  final  states  of  s4  st««  is  the  straight  line  n-n*  (in  Fig. 
14.1  a=9,  m-5)  .  It  is  necesscCj  to  find  such  control  0  (this 
trajectory  in  the  phase  spac«),  uuiiag  which  abscissa  v  —  ^ cf  end 

i  -  t 

point  .s  will  be  smallest. 

Jolve  to  the  end/lead  s«.at«u  ^rouiea  of  dynamic  programming. 


being  assigned  by  the  specific  vaiues  of  n  and  b  and  by  the  specific 
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fere  o f  the  function  /J  > * > 

uet  us  place  a  numtsi  o*.  ^lOj^cci^dS  n~1C,  a  cumtar  of  targets 

a=5. 

Functions  let  us  d^s^ii  as  follows: 

i  <r)  •=  I  —  j 

i  /;  i  —  !  -  J  n.ii-*  ...  .)  2*; 

P.i  'o  =_■  I  —  O.r.  (14.13) 

/’,(*>  —  I  —•).;*  —  0..5*  -r-  0.2*: 

P,(k)=  1  —0.5’. 
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I.et  us  note  that  fica  rive  functions  twc  P2  and  P4)  are 

converted  intc  zero  ret  cni x  wuco  k=J  ,  out  also  with  k=l,  i.e.,  the 
second  and  fourth  putfcses  considerably  smaller,  in 

comparison  with  the  first,  toe  Ciurd  and  the  fifth,  by  vulnerability; 
to  th jsa  targets  for  us  it  i<»  itoc«»ssar/  to  select  nc  less  than  on  the 
basis  cf  two  projectiles: 

ki  -> 2-  ll<  ->  2.  (14.14) 

Let  us  pass  frc»  functions  (Iw.lJ)  to  the  new  functions 

!/,,«)=  |  In /?(/„■)  |  (i  =  1.2 . 5i  (i|.i5, 

and  for  siaplif icaticn  an  cu^tawr  calculations  let  us  make  table  the 
values  of  all  functions  »,(*)  (sew  xaole  14.1). 
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Plotted 

f unctic  r 

14.2.  since 

functions 

cf  argument 

k,  then  1 

lines. 

z' 


ik) 

~  1 . _  ■"»  tnay 

are 

re 

uecerxiuei  only 

mil 

€  s 

Fij  .  Iw. i  shows 

cur 

represented  in  Fig. 
king  the  integer  values 
ves,  but  by  broken 


Process  of 
diagram.  As  the 
step/pitchr  we 
remained  at  our 
tar  gar. 


plancir.g/yx^in^  r^t  us  develcp  or.  the  standard 
value,  khicn  characterizes  the  issue  cf  the  i 
will  exaaine  .  jyubi.  a,  or  the  projectiles,  which 
disposal  aitoi  ua  extraction  of  means  to  the  i-th 


1.  we  fix/record  issue  «£  .uuitu  step/pitch  n4  -  aumoer  cf 

projectiles,  which  reaaineu  ui  w u*  disposal  after  extraction  cf 

projectiles  to  first  fcur  pu*  pose*.  i.et  us  determine  the  borders  in 

which  it  can  te  located  cy  u4.  lo  tiftn  target  it  is  necessary  to 

leave  not  less  than  one  proj«ctiu.«; 

««>  l- 

Tab  le  14.1. 


1 

|  » 

0|  l»> 

07  1*1 

v% 

V,  (A) 

1 

0 

CO 

CO 

.  O 

~ri 

l 

0.223 

■~n 

0,105 

.-o 

0.(193 

2 

0.041 

1.139 

0.010 

1 .201 

0  288 

3 

0.008 

0.552 

0.001 

0.010 

0.134 

4 

0.002 

0,298 

0(XX) 

0,358 

0  005 

5 

0.000 

0.1  09 

0000 

0.222 

0  032 

6 

o.ixio 

0.098 

0,1X10 

0.143 

0010 

7 

o.ooo 

0.058 

n.ixxi 

0,0<!4 

0  008 

8 

0,000 

0,034 

0.IXX) 

0.003 

0.1X11 

9 

0.000 

9.020 

0,1  XX) 

o  043 

0(X)> 

10 

0,000 

0.012 

0.000 

0.0.10 

o.ixii 
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Page  142. 

_)n  the  first  four  targets  «si.«  caisasad  not  less  1*2+1+2=6 

projectiles,  remained  net  jiu.  a  trial*  roar.  Thus, 

1  <«,  <4. 

It  is  obvious,  optimum  ^.cuuui  on  the  fifth  step/pitch  lies  in 
the  fact  that  all  remairing  «4  tro  jeonles  tc  isolate  into  the  fifth 
purpose:  =  .i|.  (14.16) 

In  this  case  the  value  wi  criterion  V,  reached  at  the  fifth 
step/oitch,  is  converted  iutw  ta«  uaiaun  and  it  is  equal 

V*  (/!.,)  =  v5M.  (14.17) 

This  value  for  any  vaau«  or  u4  can  be  found  from  the  latter/last 
column  of  Table  14.1.  let  as  la  ne*  table  14.2  conditional 

optimum  control  cn  the  fiftu  step/y-itca  Ks*(n4)  and  value  of 
criterion  vs*(n4),  reacted  a*.  c.xu-»  control  at  the  fifth  step/pitch. 

fable  14.2  is  ccntaineu  cy  cue  ta sir  of  optimisation  at  the  fifth 
step/pitch.  Let  us  note  that  nere  at  does  net  have  sense  to  construct 
graphs,  since  the  possible  vuiuas  of  argument  n4  integral  anc  there 


are  fee  of  then 
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2.  Let  us  set  n3  -  dujjli®!  cl  ^ra  jactiles,  which  remained  after 
extraction  of  resources  cc  r* rot  vbCjs  purposes. 


DOC 


80151508 


EiGfc  JLS* 


Page  141. 

Let  uj  determine  the  boundaries  a*.  waich  lies/rests  n3.  To  the 
remaining  two  targets  -  rcurxa  ana  tae  riftb  -  it  is  necessary  to 
reserve  net  less  than  three  r  cojoctiJ.es ,  aence 

'h  ^  3; 

on  th  a  other  hand,  tc  the  ri^st  taxes  purposes  is  spent  not  less 
1  ♦ 2 ♦  1 -4  projectiles;  reaaiaea  not  more  than  six.  Thus, 

3  <  *3  <  6. 

According  to  standard  ^^jcouuxe  to  us  is  necessary  with  each  of 
the  possible  values  cf  r3  tc  mrxixza  "prize"  for  the  latter/last 

two  steps/pitches  during  aa  ^  control  at  tae  next-to-last  step/pitch 
and  optimum  ccntrcl  cn  the  mu«r: 

Yfisi'tj.  h)  =  v.,(ki) V]{ru), 
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or,  taking  into  account  that  a*=*ij*k», 

V«ts(rta.  k4)  =  v.,{k,)-\- -V, («,_*,).  C14.!.3) 

fhe  conditional  cpt-rauia  pcxse  ^i,iW  and  conditional  optimun 

equation  k«*(Dj)  they  bail  to  xccated  iron  the  condition 

V*.s(«i)=  mi11  iV'oOm.  (>110) 

whera  the  minimum  is  taken  iu  t etas  of  ail  values  of  a  number  of 
chosen  projectiles  k4,  (eui«.ceu  vatn  anas  c3. 

Jsing  data  of  Tables  la,  1  omu  U.2  (into  tta  latter  it  is 
necessary  to  enter  with  n3-*4  aiisttsaa  of  n4)  let  us  eake  table  from 
two  inputs  for  function  (la.  id;  Taola  14,3). 

The  drawn  a  line  c xapua/ couuts  Tauie  14.3  correspond  to  the 
impossible,  with  this  c3,  va4  ut>^>  *,4.  In  each  table  row  is  emphasized 
aininuo  value. 
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Table  14.2. 


».*(«.) 

'M".> 

l 

i 

0,693 

2 

2 

0.28S 

3 

0.1. 3-* 

t 

\ 

o.or.r> 

Page  144. 

It  eqaally  V*5(n3)  determines.  couaj. tioual  optimum  control  at  the 
fourta  atep/pitch  k«*(c3).  ut  reiuce  these  data  in  Table  14.3. 

Taale  14.4  solves  cdBt>a»ce.i.j  tna  problem  of  the  cptiaization  of 
the  faurth  step/pitch. 

J.  He  optimize  third  ste p/^x^ch.  He  are  assigned  by  values  of  nz 
for  wnich  we  define  the  touauar..«s».  For  the  first  two  steps/pitches 
is  spant  not  less  than  thr**  projwctrias ;  remained  cot  more  than 
seven . 


To  the  latter/last  thr«w*  at^o/pitc he s  it  is  must  be  reserved 
not  lass  than  four  pro  ;ectj.j.«s;  uonsa guantl y, 

t  n,  7 . 

He  construct  tatle  warn  two  ^pjt  or  the  values  cf  the  function 

1  l,  t,  ^  :  i  /«’ \)  -f-  V  i,  ^  Of? — -  '{])  |  l  ■)  20) 


DOC  »  80151508  E  Ai»£  Of/ 


(Tablj  14.5)  and  aa  seek  ia  «aca  i.ai  of  this  tahla  Biniaai  cuabar: 

V i.  ■«.  s  [Vri».s(«*.  >■)))■ 

*. 


(14-21) 
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Table  14.3. 


^  !  >■  '7 

i  ' 

S  1  i.w 

II  i ll 


Table  14.4. 

",  1  MV 

V\.  5  K)  ! 

1 

"  ;  1 

i  ,m  | 

■t  •  .1 

1,309  j 

•>  [  .5 

0.904 

;  11  1  *  i 

0fWft  1 

!  1 

I.UiO  :  i  — 

».< mTi  !  i  .or. i  i  — 

o.tTTi  o.ii-m  i  d.015 
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Je  stress  in  each  tc  a  aiinzmam  number,  find  fc3*(n2)  and 

* 

vj»*/s(n2)  and  we  write/ teco..  a  tu*,u<  in  Table  14.6. 

The  optimization  cf  tae  u^u  stap/pitch  by  these  is  exhausted. 

Je  analogously  optimize  ta«»  o«coad  step/pitch,  we  find  the 
borders  of  values  n.:  c  . 

Je  construct  table  uita  tio  A^pat  of  the  values  cf  the  function 

V 2,  A?)  ~  Vzihi)  4. — A':)  (14'2‘2\ 


(see  Table  14.7) 
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L n  each  line  of  this  caula  ■«  fina  tae  oiniatum  numfcer: 

vi.  i.  <.  5U1)  =  min  I.  s('ti.  *jj|.  (11.2:5) 

», 

4e  further  construct  ca*il«s  lui  iue  optimization  of  the  second 
step/pitch  (Table  14.8). 


DOC  =  30151508 


E  AO  t  £69 


Table  14.5. 


X  *1 

N\ 

\ 

i 

.1  1  *  i 

l  i 

4 

2.002 

_  i  _  t 

5 

1 . 1 14 

1.007 

—  1  —  | 

6 

I.0O9 

1,110 

1.498  1  - 

1 

0.7.5 1 

0,914 

1,510  1  S07  1 

!  i 

Table  14.6. 


i 

! 

1 

!  4 

1 

2.002 

i  -i 

1 

1.414 

0 

1 

1,009 

1  7 

; 

1 

0.751  1 

1 

Page  146. 

4.  We  optimize  first  4c«f/r..c«.a;  value  n0=10  preset  and  is  not 
varied;  therefore  simjl}  we  *«•«,  HAQiiua  of  k ,  cf  function 

Vi*!:. 3.4.5(10.  ftl)  =  v,(A,)  +  W..3.4.s(lO  —  ft,).  (14.24) 

being  absolute  minimum  ct  cx^teiioa  K: 

V’  =  W.s. ).  s=mmK:, !.  ,,  5(10,  ft,)).  (14  25) 

The  values  of  function  (I4.c<«j  ai.«  given  in  table  14.9. 

Smallest  of  nuoters  la  uauie  14.9  is  equal 

V'’  =  W. 1.78-1 

and  it  is  achieved  by  c^tim-ii*  ccaiioi  at  the  first  step/pitch 
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Table  14.7. 


x  *•  I 

■"  \l 

3  1 

\ 

Iil, 

1  1 

1 

!  ft 

•’•■HI  ! 

i 

1 

7 

!  165.1  i 

2,V>4 

— 

S 

!  -'.IIS  ; 

l.‘Jfi6  ; 

-MIX)  .  _ 

0 

l.MlO 

1.717  2.171 

Table  14.6. 


1  | 

|  W 

;l/2.  >. ..  i  >  | 

!  rt  2 

i 

|  3.141 

|  7  1  2 

1  2.553 

;  8  3 

I  1.966 

0  3 

1.361 

1 
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by  j  |  J  ; 

>  '  I JO.  *•  jj  i.7vi  I  .\<*»7  ,  J.5«i i 


In  thas  case  probability^  ri  u..  cj«  uestructicn  of  all  targets  reaches 
its  naxinun: 

\V'  =  e-v  =  o  168. 

5.  Passing  again  entire  ia  juwi.ca  of  stages  from  beginning  toward 
the  ead,  we  find  unccnditio  a»  1  u^Aisum  control  cn  each  step/pitch, 
beginning  frcm  the  first: 

*;  =  i;  /*;  =  io  —  *;  =  o. 

included  in  Table  14.8  wita  a  |-*#  finu 

ftj  =  ftj(9)  =  3;  Vj.3t«.,=:  1.561. 

«,*  =  9  -  3  =  6. 


Purth  ir  we  have 
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inclu  led  in  Table  14.6  hitu  a  2-««  xet  us  find 

fts  =  /sj(6)=l  ;  V’x  4.-,=  1.009. 

Furthjr  n*  =  6—  1=5; 


Thus,  optimum  ccntroi  icuua: 

{/*  =  (!.  3.  1.  3.  2). 

i.e.,  for  achievement  cf  tne  aaa.-fc.aum  Kill  pictafcility  of  all  targets 
'W  it  is  necessary  tc  isclace  into  cha  first  ard  by  third  of  target  cn 
one  projectile,  to  the  £«cou  aiiu  rourta  puxpcses  -  cn  three 
projactiles,  and  the  reaaiui^g  two  projectiles  tc  isclate  into  the 
fifth  purpose. 


?or  the  constructicn  or  trajectory  in  the  phase  space  it  is 
necessary  to  still  ccaptte  values  v’  (i=1,  2,  3,  4,  5)  the  "gains" 
["prizes"],  reached  in  toe  s*ndj.e  stages  at  the  optimum  contrcl. 
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Me  have: 


i—l  i, 1. 1. 5 

—  1  2.  3.  1. 

5—  1.734 

—  1.501  =  0.223 

-v\  ,.s 

—  1.01)1 

—  1.000  =  0.552 

■  1  i.  1.  3 

-  vl 

=  1 .000 

-  0.904  =0.105 

-  v; 

=  0.904 

—  0.233  =  0.010 

* _ i_  •  * 

=  0,238. 

The  optimum  trajectory  wt  ei.±ut  s  in  the  phase  space  will 
appear,  as  shewn  in  Fig.  la.j. 


us  note  that  in  tax^  ^xaniaQi  ar  y  example  is  dem  cast  rated  net 
the  mast  economical  netted  i&e  solution  cf  the  problem:  perhaps, 
simpler  it  would  be  sclve  tae  cas*  c r  rational  control  not  of  the 
dynamic  programming,  bet  su, ■  i«  ua  countershaft  (number  of  possible 
versions  it  is  net  tcc  create •  newevar,  in  the  sore  complex  problems 
the  advantages  of  the  setaod  or  u / ra j ij  programing  beccme  evident. 


a)  the  distribution  cr  tasources  for  increasing  the  reliability 
cf  technical  device/eg  ca paea».  taeca  oe  the  technical 

devica/equipment  A,  which  or  a  a g gre ga tes/unit s,  or  the 

asseaolies 


F> .H. 


(Fig.  14.4) 
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Fig.  14.3. 

The  fdilure-fcee  operation  u*  aacn  or  the  assemblies  is  necessary  Eor 
the  work  cf  device/eaui j sent  A  m  a  whole.  Aggregates/units  can  go 
cut  of  order,  moreover  inoc»t.,i,au<»iit.*.y  or  each  cthar.  tha  reliability 
(probability  of  failure-free  operation)  of  entire  ae vice/equipraent  is 
equal  to  the  product  cf  tne  ..  enaailit/  or  the  single  assemblies 

w=[\pt.  (14.26) 

l  =  I 

where  pt  —  reliability  of  tu«  i  aosaaoly. 

Poc  increasing  the  reiiauiiit^  of  entire  device/equipment  is 
isolated  some  sum  cf  resources  ca.  T rase  resources  (expressed  in  the 
money,  the  weights  or  etteru^so)  can  be  m  an  arbitrary  manner 
distributed  between  the  actions,  «nioh  raise  the  reliability  cf 
single  assemblies.  In  cider  to  ^acredsa  the  reliability  of  the  i 
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assemoly  from  p,  to  P>pl.  a*.  xa  u«casidiy  to  expend  the  sum,  equal 

to  /,  t/5. />, > 

It  is  necessary  sc  to  a^dtriKUtd  tae  tempered  resources  in  order 
to  do  reliability  cf  ertir»  u  e  vics/eq  lipment  cf  maximum. 

This  task,  and  previous,  <uiu  has  multiplicative  criterion,  on 
it  differs  from  it  in  terms  vf  t as  ta.cz  tnat  the  control  carries  rot 
discrete/digital,  tut  ccctrnucus  cuaraoter  and  consists  of  the 
extraction  to  each  asseuol^  ista^e^  of  the  specific  sum  of  resources 
x  (i=1,  2,  m)  .  ;fter  .as  co-nvarsicn  cf  criterion  w  tc  the 

additive  form  the  lccar  ithaii*.  oce£ation  before  cs  will  te  the 
ordinary  task  of  distr  i  tut-i.3  tne  .es ource s/lif  etiuie s  witn  the 
redundancy  (moreover  in  its  form  when  in  each  stage  are 

expen  led/consume  d  to  tte  enu/lcau  all  allocated  resources)  ,  with  the 
difference  that  the  "income"  is  not  maximized,  tut  it  is  minimized. 

Page  150. 

rfe  recommend  to  reader  as  cne  control  tc  solve  the  task  of 
distributing  the  resources  t«  a*,  increase  in  the  reliability  with 
following  concrete/s pe c i tic/uct uaa  data 
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.vi  —  5;  =  0.90;  p.,  — 0.05;  /^  =  0.03; 

/>4  =  0.55;  />i  =  0,07. 

Z„=  t. 


fpp- 

\ 

1  III 

l  -  P  ■ 

I  ! 

f.ip. 

/>■.)  =  0.5 

In 

1  —  !>  1 

‘  —  Pr  i 

/,<p. 

Pi)=  °-5 

1  In 

i 

1  -P  , 

•  —  Pi  i 

fpp. 

/»,)  =  0.3 

|,n 

1  ~P  1 

1  —  P,  1 

/slP- 

p-)  =  3 

l  ^ 

1  —  P  I 

1  —  Pr,  1 

All  functions  /t(P)  are  deter* .Lima  only  for  P>p,  (i-1,  ...»  5). 

§15.  Stochastic  tasks  of  ayn<ijij.c  p*.cg ram aing. 

In  practice  frequently  ouca  ras*s  cf  the  f lar. ning/g lidings 

in  which  noticeable  role  pra.,  rue  raudom  factors,  which  affect  both 
the  siate  of  system  S  ard  pr*ue  «.  Iu  suca  problems,  the  controlled 
process  is  not  completely  a6t.etuu.fiBd  by  the  initial  state  SQ  and  the 
selected  control  U,  while  to  a  oerrarn  degree  it  defends  on  the  case. 
Let  us  agree  also  the  task  o*.  jUauuia g/glrding  to  call  "stochastic" 
(prob  abil istic) . 

Certain  represertaticu  auout  siaiiar  tasks  we  already  obtained 
in  §12,  where  was  found  our  rta  optimum  distribution  cf  weapons  of 
destruction  according  to  t u«  Uaiouaeu  targets.  Depending  on  the  case 
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a  nuramer  of  surviving  tc  taa^  uau«c  weapons  cf  destruction  could  be 
the  fact,  etc.,  i.e.,  the  stata  or  s/stan,  in  the  essence,  was 
random. 

Page  151. 

However,  with  the  solution  Oj.  uia  pLonlem  we  were  hounded  tc  the 
examination  only  cf  the  a veia ge/ i«a n  cnaractexistics  cf  process, 
i.e.,  they  solved  its  cct  as  stocuastic,  but  as  ordinary  problem  of 
dynamic  programming. 

This  method,  which  is  r* dnceu  to  one  fact  that  the  random 
procass  previously,  even  b<eXv,ra  solution  cf  task,  is  replaced  ty 

its  averaged,  not  randci,  aetecmrnwd  model,  is  appreximata  and  will 
use  far  net  always.  It  givas  rao.r  results  cnly  in  those  tasks  of 
which  the  controlled  system  aCii^ists  or  the  sufficiently  multiple 
objects  (as  in  §12:  aircrart,  instruments),  and  despita  the  fact  that 
the  state  of  each  of  them  vd.ia«  randomly,  in  the  mass  these 
randoanass  mutually  are  they  are  levelled. 

In  many  stochastic  tas*^  o^  ^raa nrn g/gliding  this  method  cannot 
be  used;  into  seme  it  gives  too  errors,  in  others  and  it  is 

completely  impossible.  And,  -n  any  case,  does  always  arise  the 
question:  strongly  whether  w..  ir  u«  cnaugad  optimum  control,  if  we 
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disra jard/neglect  rardcaness  aou  iu  replace  stochastic  task  cf  that 
determined?  In  cider  tc  answer  ^tusucn,  it  is  necessary  to  be 

able  co  sclve  stochastic  problems  of  dynamic  programming  taking  into 
account  random  factors. 

In  the  present  paragra^a  w«=  wj.ll  give  fundamental  approach  to 
such  casks  and  let  us  plan  ^nwiax/CJ mmon/tctal  outline  of  the 
solution.  In  the  following  a16  we  «iil  in  detail  dismantle/select  a 
specific  example. 

The  genera  l/ccimrcc/toca*  roimulacion  stochastic  problem  cf 
dynamic  programming  can  be  descried  as  follows. 

Let  there  be  the  physical  system  i,  which  in  the  course  of  time 
varies  its  state.  We  can  to  a  certain  aegree  act  on  this  process, 
directing  him  to  the  desixeu  siue,  but  we  monitor  this  process  not 
completely,  since  its  cctcse,  oesiues  the  ccntrcl,  depends  also  on 
the  case.  This  process  we  wi*  1  c®n  the  "random  controlled  process". 

Let  us  assume  that  wicn  taw  course  of  the  process  is  connected 
our  some  interest,  which  is  „ ur itsse!  o y  criterion  ("prize")  w,  which 
to  us  it  is  desirable  tc  tactile  maximum. 


Page  152 
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Criterion  H  is  additive; 

'ft 

W  =  V  wL.  (15.1) 

I  a  1 

where  —  the  "gain",  acgones  *u  tha  i  stage  cf  process. 

Since  the  state  cf  system  5  as  uy  chance,  then  random  proves  to 
be  gain  v>,  in  each  staca,  <u.d  cow&l  gain  v. 

4e  would  like  tc  select  suca  control  U,  during  which  prize  » 
would  be  converted  into  tha  mamas.  3at  can  we  this  do?  it  is 

obvious,  no;  during  our  any  ccutxuA  prize  W  will  remain  random. 

However,  we  can  select  sucu  v.c&uua  during  which  the  average/nean 

value  of  the  random  prize  *  win  no  maximum.  let  us  designate  the 

averaje/mean  value  (lathEOaucai  expectation)  cf  value  w  by  the 
letter  '4:  \?  =  ,M[U>r].  (15.2) 

Taking  into  account  fornJma  (15.  1)  and  using  the  property  of 
mathematical  expectatic  t » ,  lot  us  register  4  in  the  fcrm 

W  =  V  (15.3) 

.Ti 

whera  ■>'  —  average/nean  pm  e  m  tha  i  stage. 

FOOTNOTE  *.  The  mathematical  expectation  of  sum  of  random  variables 
is  egual  to  the  sum  cf  then  satnemat ica  1  expectations.  ENDFCCTNOTE. 
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Thus,  in  stochastic  tas*s  liioied  i  of  the  criterion  itself  W 
which  is  accidental,  is  axaiu.oau  *ts  avarage/irean  value  W;  ttis 
criterion  is  also  additive. 

The  task  of  dynauic  prca  rd&mjuig  is  reduced  to  the  following:  to 
select  this  optimum  ccrtrcx  o*,  wuxeu  consists  cf  optimum  controls 

u\.  u\ . u\  on  the  sirgle  stages  ao  tnat  the  additive  criterion  W 

would  become  maximum. 

It  would  seen,  natter  id  r.aacai  co  the  simple  replacement  of 
criterion;  however  this  net  ..aus.  Iha  dxfiererce  between  stochastic 
and  determined  diagrams  cf  aJ  oaiki.c  pro jramming  is  much  deeper:  it 
concerns  the  very  structure  wt  optimum  control. 

Actually /r°ally ,  let  is  i«c<Ui  tha  overall  diagram  of  dynamic 
programming  in  the  determine^  processes,  without  the  participation  of 
randomness  (§7).  It  ccnsxsts  or  cue  following. 

Page  151. 

Is  fixed/cecorded  the  stat«  *>r  i.ixtea  5,_,  afterward  (i-l)-th 
step/pitch,  and  for  each  cc  »uca  states  xs  sought  conditional  optimum 
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control  at  the  i  step/pitcn.  in  tn*s  case  the  state  cf  syste®  after  i 
step/pitch  S,  is  completely  aeceiaxaed  by  previous  state  S,_l  and  used 
at  the  i  step/pitch  ccrtrci  U 

S,  — »/,).  (is  f) 

Squally  prize  at  the  i  at^/^'cc a  is  completely  daterained  by  the 

state  of  system  in  th«*  ^e^aiainq  of  this  step/pitch  and  by  used 

control  U  : 

w,  =  ^ (5,.,.  Ut).  1 15.01 

So  whether  this  will  j£  xa  a^gcaa-itic  tasks?  Nc,  not  thus.  The 
state  of  system  S;  after  tn&  i  st«r/pitch  is  not  coup  lately 
daterained  by  state  5,_,  ana  control  U,.  but  it  depends  also  cn  the 
case.  State  S,  with  given  ou«s  S, _ ,  am  (/,  is  random,  and  on  given 
ones  5,_i  and  U;  depends  cul.,  p..cnabi  Lit  y  distribution  for  different 
versions  cf  state  5,. 

Jain  wi  at  the  i  stap/p-tcn  not  also  completely  determined  by 
the  previous  state  of  system  5,_,  and  oy  used  control  Ut.  but  it  is 
random  variable,  and  or  anu  (J,  depends  crly  prebanility 

distribution  bat  ween  its  pc&iiiuw  values.  But  that  as  us  Interests 
not  random  gain  itself  :;,t •  our  qlxj  its  average/iean  value  at  each 
step/pitch,  this  random  vaiuviw  .t  is  possible  to  average  taking 
into  account  probability  dis«.£iiucioa  and  to  introduce  into  the 
examination  conditicral  mean  prmo  ac  the  i  step/pitch  in  preset 
state  5,_,  after  (i-l)-tn  step/ fitch  and  the  specific  control  at  i 
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step/pitch  i',: 

ie  will  assume  that  ouu  tun  rro na jxiity  distribution  for  random 
state  Sr  and  conditional  usu..  jaia  (15. fa)  they  depend  only  oc  S,_t 
and  i',  do  not  depend  cr.  cue  “  ^eiuatj r/**  of  process,  i.e.,  from  that 
how,  when  and  as  a  result  or  wnai  control  system  arrived  intc  the 
stat9  •!>,_  |  ». 

FOOTNOTE  i .  In  other  wcras,  .nb  controlled  process  has  narkcv 
character.  ENDPCCTSOTE. 

Page  15^. 

dy  our  task  will  determine  rot  each  of  the  possible  random 
issues  any  step/pitch  ccndit-cnax  optimum  control  at  the  following 
step/pitch.  Thus,  in  stochastic  tu-agram  optimum  contrcl  itself  0* 
bill  oe  random  and  will  ue  eacn  time  realized  differently,  depending 
on  that  hew  will  be  develcpeu  raSutm  process.  The  matter  of  that 
planning/gliding  -  cr  tc  wot*,  out  the  wired  program  of  contrcl,  and 
to  inlicate  for  each  step/picen  u«  control  which  one  should  answer 
any  random  issue  of  the  prav^cus  atep/pitch. 

In  this  -  the  basic  iii^etsuoe  Between  the  determined  and 
stochastic  tasks  cf  dynamic  rrog*a«»niag.  in  the  determined  task 
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optimum  control  is  single  ana  io>  indicated  previously  as  the  wired 
program  of  action.  It  stccnaatic  .asu  optimum  control  is  random  and 
is  chosen  in  the  course  cr  pi.ocw&>  itself  depending  on  the  randomly 
established  situation,  leas  „s  -  control  with  the  "feedback"  from  the 
actual  state  of  system  to  ccuaaoi. 

Let  us  pay  attention  to  one.  iuora  oirc uastance.  In  the  determined 
diagram,  passing  process  in  ata<,es  from  tae  erd/lead  at  the 
beginaing,  we  on  each  stage  also  round  a  whole  series  of  conditional 
optimum  controls,  but  of  tas^e  as  controls  in  the  final  analysis  was 
realized  only  one.  In  stccnaatic  uiagram  is  net  thus.  Bach  of  the 
conditional  optimum  controls  Can  ^tove  tc  be  actually  realizable,  if 
the  arevicus  course  of  ranuo-  rioc«ss  puts  system  into  the 
appropriate  state. 

3ut  how  to  find  cc  cditi*.  uao.  optimum  control  1  ]■■>...>  on  the  i 
step/pitch  of  stochastic  process?  ihis  is  -  such  control  which,  being 
used  at  the  i  step/pitch,  cuv«n.u  into  the  maximum  ccnditiccal  mean 
priza  at  all  subsequent  sta^a/pitcnes :  from  the  i-th  to  the  *-th 
inclusively.  How  to  find  tnxa  maju.mua?  in  perfect  analogy  how  we  made 
in  tha  determined  diagram,  w»ra  u«  iiffarence  that  instead  cf  the 
prize  itself  which  was  acciusatai,  is  uxamined  its  average/mean 


value 
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Page  155. 

The  process  cf  plaining/  ji*u*ng,  as  always,  is  turned/ruo  up, 
baginning  from  the  lattec/ia^t  (a-th»  step/pitch.  Is  fixed/recorded 
the  state  of  system  N.,_.  attest  iu*1)-ta  step/pitch,  and  under  this 
condition  is  sought  the  ccnt^cx  u’„  (..S'  which  converts  into  the 
Baxiaua  average/eean  cc  rdit-u.tax  *-iize  «\, at  the  a  step/pitch: 

^’*(S*_i)  =  w.ix  Vj\-  <15. .*) 

when  is  found  dependenc*  u’n {Sm.{)  and  wC, (.<?„.!,)  cn  S,,.!-  the 
optimization  cf  latter/last  jtdf/^itch  is  ccapleted.  In  whatever 
stata  5m_,  randomly  arrived  .  he  system  alter  «- 1  steps/pi  tcfces,  we 
alreaiy  know  that  to  us  to  iai«  partner  and  what  maximu#  average/mean 
prize  we  will  ottain  at  tha  ..  at  t®*.  /  la  st  step/Fitch. 

Then  is  optimized  im-lj-tu  st«p/pitch.  Here  matter  proceeds  so 
not  simply.  Let  us  first  fix  sut«  Sm_7  after  m-2  steps/pitches  and 
will  find  average/mean  prize  *,(S,n.v  </„_,)  cn  two  latter/last 

steps/pitches  during  ary  ccntroi  Um_,  at  (m-l)-th  step/pitch  and 
during  the  optimum  ccntroi  o.  taw  xattec  which  to  us  it  is  already 
known,  low  to  find  this  avata ga/mwan  priza?  we  will  discuss  as 
follows.  During  any  preset  S„_2  and  control  state  S„_i  will  be 

randoa,  but  we  knew  fee  it  u.a  riduaoility  distr ibuticn,  which 
depends  on  S„.2  and  Ranuca  stata  ■'u-i  determines  by  itself 

■  axiauB  avarage/sean  ccruiti^nax  riiza  at  a  step/pitch  wC 
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average  this  value  taking  into  account  tha  probability  distribution 
of  state  We  will  cttai-  “twice  averaged"  maximum 

conditional  prize  at  tie  it  s..  ap/^tch ,  which  demands  no  longer  on 
<'„-i  (on  it  is  done  the  second  aveiagiag),  tut  cn  Sm_2  and  0'n_r  Let 
us  designate  this  prize 

^(5,.,.  V,.,).  <  13  1=1) 

rc  it  it  is  necessary  U  aajjin  average/ irean  conditional  gain  at 
(a- 1) -th  step/pitch  during  o.auo^  uin_l  at  this  stap/pitch: 

«*-■ ^,..2-  •13.'» 

we  will  obtain 

—  ic'n- i  <S*-2-  ’t-  'l7-.  (J5.10) 


Page  156. 


Let  us  find  the  ccctzol  cn  i*-1|-ih  step/pitch  with  which  value 
(15.10)  is  converted  into  tm»  lajuuui : 

"  ••i-,. /« . . x(h'.;.,.m(s„.2.  = 


‘-Vj-  y«.,)+  05.11) 


Let  us  designate  ttis  c«_  LJ^uoni  1  optimum  control  i1.,  >S.„  ,i. 

Thus,  as  a  result  of  optiaizats.cn  of  (a-l)-th  step/pitch  are  found 
conditional  optimum  ccntrci  and  corresponding  to  it 

maximum  average/mean  conditional  ^rira  on  two  latter/last 
steps/pitches  u  \ 
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Analogously  is  cptiaizea  a.u /  i  step/pitch.  For  each  issue  of  i 
step/pitch  S,  is  already  Juica  a  uouuicioaal  maximum  a ver age/mean  prize 
at  the  subsequent  steps/pitc^es; 

U?,\ ; . „(5,).  (15.12) 

iince  state  5,  is  ranao*  au  its  distribution  depends  on  S,_, 
and  U then  it  is  pcssibla  *.  anuou  gala  (15.12)  to  average  taking 
into  account  probability  dis*.rinu4.ioa  St  and  to  obtain  the  "twice 

averaged"  gain  =. 

U"'.m . U:). 

After  forming  it  with  the  dvaid^s/uein  prize  at  the  i  step/pitch 
during  any  control  V  »e  wix*  ouwin 

v  " .  .  .  )  = 

=  v,  ,  .S',  _ ..  U  H-  v',  -  I . *16',-,.  u.h  <15  1 1) 

Random  optimum  control  on  i  oC6r/^it:ii  f/* will  be  located  as  the 
control  during  which  value  (l5.log  reaches  the  saximum: 

.  , „ '6. . ,)  =  ms  ; vv” cs, _ , .  u,\)  = 

/' 

i 

=  :u.i X  '  •<  .5,-.,  t/.j  +  l£., . t/,)}.  (15.11) 

Applying  formula  (15.  In*  ccnoocutivsly/seriall  y  at  each 
step/pitch,  let  us  find  aau.tibi.ai  optimum  control  and  maximum 
conditional  mean  prize  on  ao-.  ste^/p  itches  cf  process  to  the  second 
inclu  si/ely . 
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Page  157. 

The  optimization  cf  the  firs*.  step/pi. tch  has  sets  special 
features/peculiarities,  ccnnacttu  «ich  the  fact  that  the  initial 
state  s  0 ,  as  a  rule,  random  j.s  uot  and  it  must  net  he  varied  taking 
into  account  probability  dis*.riuutioa  ‘ . 

FOOTMJTE  i.  For  simplicity  pigmentation  we  take  only  that  case 
when  3 o  in  the  accuracy  *nowm.  tau 1 OOTNOTE . 

Since  SQ  is  not  by  chance,  tatn  uux.  random  (completely  determined) 
will  ae  the  optimum  ccntrci  uming  the  first  stage,  and 

averaje/mean  priza  taking  j.jj*.c  ucewuat  this  stage  will  te 

w' =  if*.  2 . (i  ■>.!:,) 

Thus,  the  process  cf  agamic  programming  is  completed;  is  found 
the  optimum  ccntrci 

u'  =  (ul  UnSt).  UuS7) . (4(Sm_,)l.  (15.  Ml 

all  eieaents/cells  of  whica,  excort  taa  first,  are  random  and  depend 
on  th )  state  of  system,  (cacr«s3poaa.».ng  to  this  ccntrci  maximum 
average/mean  prize  is  eguai  tc  (In.  15). 

deco  omen datiens  regarai4»g  *.ue  use/application  of  this  ccntrol 
are  given  in  the  following  twca;  at  taa  first  step/pitch  to  apply 
contral  t]*t  and  to  await  ta«  re.ajj.ts  of  tais  step/pitch;  on  the 
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secoai,  depending  on  issue  a4  ox  iae  first  step/pitch,  to  cheese  the 
optimum  ccntrol  0*2(SX)  ana  ac 
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Page  153. 

§16.  example  stochastic  tas*.  or  cut  iynaurc  programming:  the  combined 
fire  control  and  of  explcrat-.cn. 

let  us  consider  an  elamoatorj  example  stochastic  task,  of  dynamic 
programming. 

Is  produced  shooting  at  sum*  target  Is.  In  our  disposal  there 
are  b/  m  cf  projectiles;  rot  tue  abstraction  cf  target  it  is 
sufficient  one  incidence/imjj-.ag«iiiaut.  inots  are  not  depended;  the  hit 
probability  into  the  target  »ita  aaca  snot  is  equal  to  p.  Each 
projectile  has  considerable  aCst/value,  and  therefore  tc  undesirably 
expend  projectiles  fcr  notnrug,  ou  tie  already  affected  target.  He 
have  the  capability,  i  f  we  w-.sa,  attar  «ach  shct  to  produce 
exploration  (for  example,  to  seua  r econnarssa nee  aircraft)  and  to 
estao  lish/i  nsta  11,  is  adecu  4  tai.aet  or  not:  if  it  is  affected,  we 
will  cease  shooting  and  pa*.t  or  t-o  projectiles  will  ta  saved. 
However,  to  too  frequertly  s«no  o  ».  rlo  ra  ti o  n  is  net  advantageous, 
since  this  dearly  is  bypassea,  uut  uiract  damage  to  target  in  this 
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case  we  will  not  plot.  Arisen  tea  question  about  the  raascnable 
control  of  the  process  cf  tn»  ucanarimeat  of  target  and 
reconnaissance  operations. 

It  is  obvious,  the  soiuwiut  «us;  ispand  cn  cost  cf  projectile, 
the  cost/value  of  exploration,  ana  also  froa  the  value  of  target.  Let 
the  cost/value  cf  projectile  s;  turn  rost/value  of  one  exploration  r; 
in  the  case  of  the  destruction  o t  target  we  obtain  the  "premium"  of  A 
(expressing,  for  exaaple,  o j  cn«  cost /value  of  target  itself,  either 
by  the  cost/value  of  the  reaucin*  wort  or  the  opponent,  or  finally  by 
our  material  damage  which  re  was  ^ossinle  to  prevent,  after  striking 
target) .  our  task  -  cf  planu^a*  uvabardmeat  and  exploration  sc  as  tc 
become  maximum  pure/clean  "incou*"  froa  the  entire  operation 
("incomes"  froa  the  expenditures  or  projectiles  and  send  operation  of 
prospectors  it  goes  without  ace  considered  negative).  To 

select  optimum  control  -  taju.  a «a**  to  indicate,  when  (after  what  in 
order  of  firings)  it  is  nece^saij  to  3end  exploration  and  when  to 
cease  shooting. 

The  physical  systea,  wir.cn  w«  manage,  consists  of  the 
informational  component/ linx  (*iosreotor)  and  weapons  of  destruction 
(projectiles)  .  The  process,  wmon  taxes  place  in  the  system,  is  the 
random  controlled  prccess,  n.d  tu«  task  of  optiiizaticn  must  be 
solve!  on  stochastic  diagram,  unterion  is  average/aean  "inccae"  if 


i 
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froa  the  entire  series  c t  w<ia.sa ui  (shooting,  exploration). 

In  this  example  we  dear.  concerning  tns  discrete/digital  random 
controlled  controlled  pxcc*£a  an  ccucse  of  which  system  S 
irregularly ly  passes  of  one  stare  to  another.  Let  us  determine  the 
possible  states  of  system  as  borrows. 

Page  159. 

Ha  will  indicate  that  system  s  os  ra  state  S4*'  (0  •).  if  shooting 

at  the  target  is  not  yet  com^letau,  out  from  the  aoaent/torque  of 
obtaining  the  latter/last  itucrm«t*oa  moat  the  target  is  produced 
exactly  k  of  shots  1 • 

FOOTNJTE  *.  Let  us  note  that  t am  rafarmatron  about  the  target  can 
consist  only  of  the  fact  tna»  tam  "target  is  not  affected”,  since 
otherwise  shooting  would  oe  aameuratwly  ended.  ENDFCOTHOTE. 

For  example,  "state  n  muriates:  is  recently  produced  the 

exploration,  which  discover*,  that  the  target  is  not  affected,  and 
shooting  is  continued.  It  rs  cuv*ous,  if  shooting  yet  was  not  begun, 
system  also  is  in  state  S4'”.  srac*  au  identically  it  is  known  that  the 
target  is  not  affected.  “State  means  that  from  the 

■oment/torgue  of  the  adtissron  or  the  ratter/ last  information  about 
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the  target,  consisting  in  ta»  xac t  taat  tae  target  is  net  affected, 
are  produced  three  shots  ana  as  not  yet  aade  decision  about  the 
curtailaent  of  shooting. 

If  shooting  is  endea  at  an j  reason  (are  spent  all  projectiles, 
either  it  is  discovered,  taan  tan  target  is  already  affected,  or  is 
simply  accepted  the  solution  to  c«*3 a  snooting),  then  we  will 
indicate  that  the  systea  as  -  a  s«.at*  Sim)- 

3y  letters  5**’  by  suti«^3cxnc.«.s  we  designate  different  possible 
stata-s  of  systea.  One  ctght  not  to  confuse  then  with  designation  St. 
which  designates  the  state  o*  systea  after  i-th  step/pitch.  In  our 
procass  the  number  of  slep/p-tcn  <-11  not  at  all  ccincide  with  the 
nuaber  of  state. 

As  the  phase  space  let  as  consider  points  s"*\  Sn) . S<"’"l>.  Sim>  on 

the  axis  of  abscissas  (Fag.  1  o.  1>  . 

The  transition  of  systew  an^a^tlyly  from  one  state  into  another 
we  will  represent  as  arrow/ro  inter,  is  saown  is  Fig.  16.1. 

Let  us  divide  process  an  to  tee  steps/pitches,  natural 
"step/pitch*  in  this  case  a*  "snot".  Tae  fact  that  in  actuality  can 
be  carried  out  not  all  a  cx  •note,  aust  not  ccnfuse  us:  always  it  is 
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possiole  the  afterward  latt«*./i.aa«  aotualiy  dene  shot  tc  count  off 
■entally  still  several  fictitious  ones,  so  that  the  total  nunber  of 
shots  (real  and  fictitious)  «cu ia  ue  always  equal  tc  a. 
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Fig.  16.1. 
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Page  160. 


"•xplaration"  we  will  net  co*ac  rot  c as  single  step/pitch,  since  the 
otherwise  total  nunber  cf  st« ps/p itches  would  net  be  fixed/recorded. 
If  after  this  shot  is  produced  vocation,  then  we  will  carry  it  to 
the  sane  step/pitch,  as  shot. 


Thus,  we  have  three  var«ec^«s  of  the  steps/pitches;  shot,  shot 
with  the  subsequent  exploration  ana  fictitious  shot. 


Let  us  consider  pcssioj...  controls  at  each  step/pitch.  If  system 
is  in  state  S -  sheeting  .s  aar.aiy  ended,  then  there  is  no 
selection,  and  the  only  passibxa  (it  and  optiaue)  control  will  be: 
not  to  shoot.  But  if  systea  .s  xu  state  S'*’  —  l).  then  at  our 

disposal  there  are  three  versions  of  the  control: 

U'"  ~  to  do  first-order  ster /paten ,  i.e..  to  shoot  and  not  to  send 


exploration. 
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Li'J  —  to  do  second-order  i.e. ,  to  shoot  sad  to  send 

exploration, 

U'"  —  to  do  third-order  sx.mt/ti^s.uu,  i.  a.,  cease  shooting  and  to 
produce  fictitious  shot. 

Let  us  agree  to  consider  roar  it  tne  exploration,  execution  at 
the  previous  step/pitch,  brougnt  mforaaticn  "target  it  was 
affected",  then  shooting  xaaadxat* ry  ceases,  i.e.,  control  f/(3)  at 
the  following  step/pitch  is  rorceu. 

-et  us  describe  the  mot-.cn  or  point  i,  which  represents  the 
stata  of  system,  in  the  phas«  sr«oe  (Fig.  16.  1)  .  The  initial  state  of 
system  S„  is  completely  dete*.mruwu  coincides  with  point  »v""  Final 
stata  S,m  of  point  is  compreterj  datermrned  coincides  with  point 
Stn).  dowever,  the  inter aedrare  positions  of  point  S  can  be  different, 
depending  on  the  used  ccntro-.  anu  success  of  shooting.  For  exasple. 
Fig.  16.2  depicts  this  ccncc« c«/sp«CL  fxc/actual  realization  of  the 
random  process:  first  are  ao<*e  tar»e  snots  without  the  exploration; 
point  S  irregularly ly  is  aov*d  nu»  S'"'  in  s'".  S,:'.  S'".  After  the 
third  shot  is  produced  the  eipj.oiac.ion;  it  is  explained  that  the 
target  is  not  affected,  ana  p>cxut  a  is  returned  to  state  S1'". 


Page  161 
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Than  is  produced  four  additional  suots  (point  it  is  aoved  in 
.S'"’.  s‘:>.  5'1’.  s'*1),  it  is  sent  Mpiouti)o«  it  discovers  that  the  target 
is  affected,  and  shoctitg  c<as<a  i*oint  S  it  juvps  frca  514’  in  S1™’). 
after  which  it  is  continueu  the  Leading  ot  fictitious  shots,  if  they 
yet  not  all  are  spent. 

Each  trajectory,  snixa*  to  suae  to  recently  depicted,  consists 
of  a  juaps  (displaceaenta/aow aa«at*)  of  the  phase  space,  aoreover  to 
all  fictitious  shots,  prcduced  aiuealy  in  state  5*'"'.  correspond 
" juaps  on  the  spot"  with  tne  £•  tu. &  » o  .  he  sate  point  .S'"".  After  each 
step/pitch,  at  which  was  useu  ccuticl  (/'*’  (shot  with  the  subsequent 
exploration),  pcint  s  can  on^y  oituec  return  in  5<m  (if  exploration 
it  coaaunicated:  "target  was  not.  aiftctad"),  cr  pass  in  S,m>  (if 
exploration  it  coeaunicateus  "target  was  affected",  and  is  Bade  the 
decision  to  cease  shooting),  hat  us  note  that  the  solction  to  cease 
shooting  to  coapletely  tnou^atioas*y  accept  afterward  Proceedings 
"target  it  is  net  affected",  siuce,  keeping  it  Kind  to  cease  shooting 
with  iny  report  of  explcratico,  it  would  oe  net  aore  reasonably 
coaplrtely  send  it  and  net  p«.ouuc«  the  senseless  expenditures  r. 

iefore  us  will  cost  tn«  tas*  -of  selecting  optiaua  control  at 
each  step/pitch,  i.e.,  to  iuuic«t*,  which  of  three  controls 
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u  ■  u '  •  V  must  be  applied  at  taia  step/pitch  depending  on  the  issue 
c£  tha  previous  step/pitch.  *c  obvious,  optima  control  aust 
depend  on  the  parameters  cl  tn*  *i:obleaj  number  of  projectiles  a,  hit 
probaoility  p,  cost/value  or  projectile  s,  cost/value  of  exploration 
r  and  the  ’’premium"  of  A.  us  awta  tuat  kith  some 

ralationships/ratios  of  the  ca£aa«ters  tha  prcblaa  is  solved 
trivially. 
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For  axaaple,  if  s>pA,  i.e.#  xh«  ia«as  cost/value  of  cne  projectile  is 
■ore  chan  average/aean  (ion.,  wixith  it  fields  with  one  shot,  to 
shoot  not  at  all  has  sense,  *.*•,  at  axi  steps/pitches  it  is 
necessary  to  apply  ccnticl  U(3i.  xt  x>A  or  r>as,  tnen  it  has  sense  to 
pcoluce  exploration  and  ccut^cx  Ui7)  lust  not  be  applied  not  at  one 
step/pitch. 

net  us  consider  tie  g*>n»rax  Ca£3  (at  any  values  cf  the 
parai  iters)  and  Mill  ccnstxu«.t  ta«  diagrax  cf  the  solution  of  problee 
by  the  aethod  of  dynamic  proa raaaxng. 

Pirst  of  all  let  us  esuioxxsa/iastall ,  from  what  states  into 
Mhat  passes  the  systea  undex  tu»  exfact  of  specific  controls 
Uu>.  Ur‘\  Uu)  and  what  in  this  cas«  it  is  obtained  average/aean  prize. 

Proa  the  state  5(n>  the  ays.»«  cannot  pass  anywhere  else:  single 
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possible  (it  and  optimum)  cu Uci  is  Uu>\  prize  w,  (and  it  goes 
without  saying  average/tean 

•i)  in 

this  jase  at  any  i-th  ste p/V^tca  equal  tc  zero: 

w,  (S1**)  =  to,  (S1”1)  =  0.  (16.1) 

If  sy  ste  a  is  in  state  Slk)  (0  <  k  <  m  —  1).  its  further  behavior  and  prize 
at  i-  ch  step/pitch  deperd  cn  control. 

Let  us  assume  that  is  uaeu  control  C/‘n  (shot  without  the 
exploration),  system  passes  ..roe  S4*’  to  following  in  order  state 
S(*M>.  unless  ended  all  pro je*. tuesi  if  on  the  next  shot  ended 
projectiles,  system  passes  lato  state  S1'"’. 

The  prize,  which  we  in  mis  case  will  obtain,  does  not  depend  on 
that,  passed  system  in  S'**"  or  in  S<n>.  it  consists  of  two 
coapoaents/terms/addends:  not  ranee a  and  randcm.  Not  random 
com poaent/ter a/addend  is  negative  anl  is  equal  -  s  (we  for  sure  lose 
with  the  shot  the  cost/value  or  rrc jactila) .  Fandom 

coaponent/tera/addend  is  pos^ti and  the  preaium  which  we  on  this 
shot  can  obtain,  but  we  can  ana  not  ootain.  Preaium  will  be  obtained 
at  this  step/pitch,  if  tne  cetr ascending  shot  proves  to  be 
successful,  will  strike  target.  .<tt  us  find  the  probability  of  this 


event 
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So  that  the  target  would  bo  afx«.ct«d  ay  tae  data  by  shot,  it  is 
necessary,  in  the  first  plac«,  so  that  it  would  not  be  affected  by 
previous  k  by  the  shots.  Cdie  iocu  aiaca  would  be  obtained  information 
"target  it  was  net  affecteu";  luxtaermoxe,  it  must  be  affected  by  the 
precisely  this  shot.  The  pxo„aoa.i.j.ty  of  tnis  set  of  events  is  equal 
to 

(l  —/»)*/>■ 

with  chis  probability  this  saOt  Wj.j.1  axing  to  us  "income"  in  the  form 
of  premium  A;  with  probability  l  —  (1  —  p)kp  it  will  net  bring  to  us 
incoms,  i.e.,  will  bring  "jawflats".  Avarag*  value  A  and  0  taking  into 
account  their  probabilities;  Ww  wj.^1  on  tain  average/mean  income  from 
this  shot 

4(1  —  />)*/»  + 0  (l  -('  —  P)*P\  —  —  ptp- 

Subtracrting  from  it  tne  c*st/vaiua  ox  projectile  s,  we  will 
obtain  the  f uH/total/compie^e  avexage/mean  prize,  acquired  on  one 
i-th  step/pitch  in  the  initial  state  of  system  5'*’  and  control  Uin: 

wt  (s‘*\  Uu>)  =4(1—  p)*p  —  s.  (1 6.2) 

bet  us  assume  now  that  to  tn«  system,  which  is  found  in  state 
is  used  control  Ua)  (saio*  w**.n  taa  exploration)  .  Further  fate  of 
system  depends  on  what  informer *cu  it  will  communicate  exploration. 

If  this  information  will  oe  "tax*«t  affected",  then  system  will  pass 
into  state  Sia),  if  "target  is  axxectei",  taen  system  will  pass  into 
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stata  5  Probability  cf  ri*.st  or  taese  events  is  equal  (' —  p)  ;  of 
the  3acond  1  —  (1  —  />)**'. 

i.et  us  count  avera  ge/iadan  daring  the  use /application  of 

central  u{V-  It  is  conpcsad  o,.  tn*  ..eliaoia  ex Fendit ure/con sumption 
(cost/value  of  projectile  anu  exrxontion)  ,  equal  -  (s«-r)  ,  and  the 
average/mean  income,  equal  ij  A(\—p)kp\  altogether 

u{2))=  A{\  —  p)k p  —(s  +  r).  (16.3) 

let  us  assume  that  to  tna  system,  which  is  found  in  state  S l*\  is 
used  control  U  (sheeting  i;  *s  «iidji)  .  Point  S  will  move  in  and 

priza  (both  actual  and  avera* a/mea«)  will  be  equal  to  zero: 

w,  ($'*'.  t/,3>)  =  0.  (16.4) 

Page  164. 

delying  on  these  data,  ■ a  win  construct  the  process  of  the 
optimization  of  contrcl.  Let  us  uo*ia  with  a-th  step/pitch.  Let 
afterward  (m-1)  step/pitch  t**a  system  oe  in  state  5,„_,  (it  is  not 
necessary  to  mix  this  stats  wits  *<niat  s'*'11!).  There  can  be  twe  cases: 
either  we  have  already  teen  ..cuua  at  point  S'm'  (shocting  it  is 
ended)  : 

or  shooting  is  not  yet  ended,  ana  than  we  can  be  found  in  any  from 
the  raaaining  points: 

=  s'*’  (0  — i). 


ooc 
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In  th  i  first  case  the  only  (and,  obviously,  optimum)  will  be 

control  (/”: 

U'm  (51'"')  =  U(i).  (16.5)  . 

In  the  second  case  possibly  ji  two  controls:  u'"  and  UiM  (since 

to  send  exploration  after  laao^Aas:  snot  no  longer  has  a  sense). 

Lat  us  find  average/ me  an  pci^a  u  the  latcer/last  step/pitch  for  each 
of  those  controls.  If  we  mi.  use  control  Ul,)  (shot  without  the 
exploration),  then  average/ia«au  ze  at  a-th  step/pitch  will  be  (see 
formula  (16.2)) 

U'°)—  /l(l  —  p)*p  —  s  (k  =0.1 . m  —  I). 

(!&«' 

If  we  will  use  control  U(3>  (.<<.  ua  cease  shooting)  ,  then  average/mean 
prize  at  m-th  step/pitch  vilj. 

U'")  =  0.  1 1 6.7) 

Conditional  optimum  coutcor  at  a-th  step/pitch  f  'j.S*1')  will  be 
that  with  which  this  mra^e/neoii  rr rza  reaches  the  maximum: 


Thus,  if 


\v',„  (S1*1)  =  nirixj  <■!(  1  — />)*/? — s;  0).  (16.8) 

.3(1  —  p)‘p  —  s  >  0. 


then  it  is  necessary  tc  chcoae  at  w-th  step/pitch  control  (/";  but  if 

-3(1  —  p)*p  —  s<0. 

-  control  U{i'-  The  optimizatroa  or  ± at  ter /last  step/Fitch  is 
completed. 


Page  165. 
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Let  us  switch  over  to  o*  tmix&txon  la-1)  of  step/pitch.  Let 
afterward  (m-2)  step/pitch  tna  sy*te a  ua  in  state  s«-v  Here  again 
there  can  be  two  cases:  aizuac  snwo ting  is  ended,  i.e. 

c  —s'm) 

cr  it  is  not  yet  ended: 

Sm_i  =  Slt)  i0<k'm  —  2). 

If  5m_,  =  S{m).  again  the  cniy  poss.*.ula  control  is  U{3).  and  aaxiaua 
average/mean  prize  at  two  xa «.  CaA/x«st  steps/pitches  is  equal  to  zero 

U’„.l(S{m))  =  Um;  =  0.  (16.9) 

Let  us  find  conditional  o^txaua  conrrcl  and  conditional  saxiaua 
average/mean  prize  cn  two  iaxtax/xoSw  .steps/pitches  whan 
S„_2  =  S'*'  (kA--m).FoT  this  let  us  cc-wa-uac  a/arage/aean  ccnditional  prize 
at  two  latter/last  st«p.»/rxtcaa.i  during  any  control  at  (a-1) 
the  step/pitch  and  optiaua  c«.at iaj.  at  a-tn  step/pitch.  Let  us  look, 
in  that  is  converted  this  px*  za  uuxiag  coatrclsC/uiC/(J,t  t/(3>at  (m-1)  the 
step/pitch,  and  let  us  select  uec-a*  chase  three  values  great. 

da  know  that  the  systaa  area.,  a-  i  steps/pitches  is  in  state  s‘*\ 
L9t  us  use  to  it  to  (a-1)  eta  p  central  Ut]).  In  this  case  is  uniquely 
deter ained  the  state  cf  tna  *yata*  aetjeward  (a-1)  cf  the  step/pitch 

C  _  C(*-M) 

1  —  O 

and  average/nean  prize  at  ia-  cue  scap/pitch  will  be  deterained  by 
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foreula  (16.2).  Therefore  w«  caa  aiamadxata  ly  write  the  expression 

^AO-pfp-s-h&US'**").  /  (16.10) 

Page  166.  I 


Let  us  assune  that  is  control  Um.  Priize  will  be 

coaposed  cf  prize  s»,.\  at  (sr-  1j  u«  step/pitck  (see  fcraula  (16.3)) 
and  twice  averaged  aaxiaua  p«.  xr«  at  latter  /last  stLp/pitch  It  we 

will  find  as  follows.  In  pre»at  state  S(t>  after  wand  (r-2)  step/pitch 
and  daring  control  L/(U  t aw  sustain  wicb  probability  (1  —  /»)*“'  will  pass 
into  state  S“".  and  then  taxiwaa  averxgw/mean  prizfe  at  the  latter/last 
step/pitch  will  be  equal  to  wx  ta  pr  obabi  lilty  1  —  i  >  —pf*'  it 

will  pass  in  and  then  pr-ze  at  taa  iattar/last  step/pitch  will  be 
equal  to  zero.  Averaging  tn&as  two  prizes  taking! into  account  their 
proba oilities,  we  will  obtain  J 

ua,)=o  —p)*"\v'(st) 

and  Ui7')=  I 

=  -•1(1  -/»%-<* +  0+0  -  P)*+'\r1(stn').  (16.11) 


Finally,  during  control  U{  at  (i-l)  the  step/pitch  average/eean 
priza  for  the  latter/last  two  so«ps/pi.cnes  will  be  equal  to  zero: 


U,J,)  =  0. 


(16.12) 


Let  us  find  naxiaua  or  torse  vaxuas  (16.]0),  (16.11)  and 


(16.12)  : 
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W'fl-I,  „{sik')=  max 


Ul"). 

(s(*\  u(2)). 


[Md— p/p-,+n(5‘*n 
—  m,ix ,  /t  ( i — />)*p  _  (S + 0  -f-  ( i  _  P) v;  (s(01).  • 
I  0 

(16.13) 


Then  froa  controls  (/“.  ^<2>-  l/11'-  at  waion  reaches  this  aaxiaua,  and 

a 

thera  is  optiaua  conditicnai  control  t/^-iOs'^at  (a-1)  the  step/pitch. 


Page  167. 


Is  in  perfect  analogy  o*-tx4iu.a«»d  aay  (i-th)  stap/pitch  (l<i<a). 

Piksiruea  isxod  (i-1)  step/p-. tea  S,_,-  if 

c  _ c'm) 

j|-i — >3 

the  further  control  will  oe  U{3)  *uu  prize  at  all  subsequent 
steps/pitches  zero.  If 

(0  <*<;_)), 

the  further  behavior  cf  syst«»  a&u  avecage/aean  prize  depend  on 
control.  If  to  i-th  st«p/piu;h  us«d  ccatrcl  U{1).  then 

5,  =  5<*+l>. 

and  Wi.u , . ,(5**’.  {/“)  = 

O+i^, . ,(s‘*\  I/"’). 

--4(1  . «»  (16-M) 


l.Bt  ns  assuae  that  at  i-  ta  s«»p/  pitch  toward  the  systea,  which 
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is  found  ia  stataS**’  (*  +m)  is  control  f/'1’  Avacaga/aaan 

pciza  «r?.i . «  Mill  t«  co*ras«a  wf  avaragt/taan  pciza  «,  oa  i-th 

tha  stap/ pitch  (saa  fcriul®  k1o.j>>  znl  tuica  avacagad  aaxiaua  priza 
if'*  ,  ,  at  all  lattar/las*  sta^s/p Atcnas*  taginning  (!♦  1)  .  This 

taica  avaragad  pciza  lax  as  *,xna  sata  taa  half  ct  tha  fclloaing 
caasoaings.  In  pcesat  ctata  S1*’  a^tacvacd  (i-1)  stap/pitch  and  during 
control  i/1’  at  i-th  stap /pxtch  s/scas  with  probability 

will  pass  in  •$“”  ana  u«a  saxxsus  avaraga/aaan  priza  at 
tha  latter/last  steos/pitcna* ,  c«**aniag  (i*1),  thaca  sill  ba 
(?*.  i...  .  ..IS1"’)  (this  pciza  wa  a.u.aau*  *.a  found*  optiaizing  <i  ♦  1 ) 
step/pitch);  Mith  pcctatiiit4  1—  (I—  />)**'  tha  systaa  sill  pass  in  s<"' 
and  than  avaraga/saan  pnz«  *t  auojogannt  staps/pitchas  Mill  ba 
egual  to  zero.  Averaging  tn**a  vmo  pcxr«t>  taking  into  account  thair 
pcobaailitias,  m «  Mill  cbtax* 

. «($“’•  . .(SM) 

and  _ 

Wf.i+t *(5<*>.  A(\  —  p)*p  —  f j  — J—  r )  — f— 

+U-«#Mr;a . „($«"’).  (16  !.->» 

Fage  163. 

Finally*  if  to  i-th  3t«r/p^tan  axil  oa  usad  control  U 
avaraga/saan  priza  at  all  suwsa^u«nt  staps/pitchas  bill  ba  agual  to 
zaro: 

, . «($'*’.  i/*'1')  —  0.  (16.16) 

hat  us  find  aaxisus  or  «  Xf^Msions  (16.14)*  (16.15)*  (16.16): 
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.  Utn). 

< , . 

i . m(  S'*')  =  max 

..  m  (5'*’ 

.  t/2'). 

1 

.... 

..-(s''1 

.  tfM) 

I  .4(1  —  pi*  p  —  W'l*.. ... 

")•  ' 

Ml-pfp-v+n-rO -/»)*“  U^,,.  .„(.s,<”).  • 

I  0 

(16.17) 

The  control  —  U'u.  U '*  or  U‘".—  a t  kiuch  is  achieved  this  laxiaua,  and 
thera  is  conditional  cftiaua  c&Mt*ol  at  i-th  stap/pitch  t/KS**')- 

’ha  optiaizaticn  ct  the  file*  step/pitch  is  iapleaentad  cn  the 
sase  principle,  with  the  (iaciacehwe  that  initial  stated”  is  not  by 
chanca  and  hypotheses  atcut  .t  to  *a*e  not  necessary. 

If  to  the  systes,  which  is  round  *a  state  S'".  cn  the  first 
step/pitch  ccntrcl  if".  them  .t  u*«u  passes  into  state  and 
average/aean  prize  sill  he 

■f ,  i .V U- 1 ')  =  Ap  -  ,  4-  r),  y . ,  (S' ' ).  .16.13) 

If  Mill  be  used  if''.  tie*. 

&>'  S'".  (/'•■’)  = 

~  Af’  —  t.v  -C  ni,|  —  //.«?'*,  .  ,.,iSn').  (16.19) 

If  will  be  used  if",  the* 

U"")-o.  da  20) 

Page  169. 


jptiaua  control  cn  the  .list  st«p/pitch  is  found  froa  the 
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r 


«/’  =  <  i . .(0  = 

,ip  _j4.it>;, . .(s'"). 

Ap  —  (s  +  r)  -f- ( 1  —  p)  VP],  j, ... 

0 


.(sn 


(16.21) 


Thus,  th«  constructicn  cf  control  by  randca  process  is 

ccapleted. 


-et  us  consider  a  specific  exaapl*.  Let  a*6;  p*0.2;  s*1;  r*0.4; 
A— 8 .  Let  us  deteraine  cptxaoa  control. 

Let  us  lead  the  optxaa.zaU.cu  of  lxtter/last  (sixth)  step/pitch. 
If  afcer  five  steps/p  itches  xs  already  ended  (S*‘T  then  we 

apply  control  U'31  (we  dc  not  sneocj  we  detain  at  the  sixth  step/pitch 
average/aean  prize  it  attar  five  steps/pitches  state 

■?*’(0  <  ft  5).  then  the  selection  ot  opt^aua  contxol  is  achieved/reached 

detarained  by  the  sign  cf  ca«  axxr»ranca: 

A(l  —  p)*  p  —  s;  (16.22) 

if  it  is  aore  than  zero,  it  *s  e^xiad  control  (/".  if  lass  than  zero 
-  control  U*3)  Let  us  eexpute  tne  values  of  difference  (16.22)  for 
different  values  cf  k  ana  tea  u»  reduce  taea  to  the  table  (see  Table 
16.1).  In  the  saae  table  in  *vo  xuwer  lines  let  us  give  optiaua 
control  at  sixth  step/piten  ul(S,ty)  and  corresponding  aaxiaua 
average/aean  prize  in  tn*  matter /last  chair  cf  the  saae  table 

let  us  place  the  saae  data  ui  ca*«  S,  = 
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table  16.  1. 


1  * 

0 

7 

3 

4 

3 

«  i 

i 

<4(1  —P)“  P  —  s 

0.60 

0.28 

0,02 

<  0 

<0 

<0 

_  1 

U* 

(/'" 

(/"» 

V" 

u,h 

u' 31 

U'3) 

U'"\ 

K(?") 

0.60 

0.28 

0 

0 

0 

0  ! 

i 
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Table  16.1  contains  ta«  ia^i/ tot ai/coa plate  results  of  the 
optiaization  cf  latter/last  atSr/^itoh.  It  is  possible  to  focaulate 
thea  as  follows.  If  were  prcuccau  already  five  shots  and  the 
lattar/last  infomaticn  about.  ta«  car  gat  (target  is  net  affected) 
they  acted  recently  (k*Q)  ear. o«i.  tuc  oae  shet  tc  that  (k=1),  or  for 
twe  saots  (k*2)  ,  then  it  is  .ic«M«ry  co  produce  latter/last  shot, 
aoreover  without  the  explcra«.ic<u  icoitcoi  l/").  Eut  if  froa  the  tiae 
of  obtaining  the  latter/last  nation  abcut  the  target  are  already 

released  three  or  acre  than  «aou,  then  saould  te  ceased  sheeting. 

Thus,  our  optiaua  behavior  at  tie  sixth  step/pitch  in  the 
accuracy  is  defined,  no  aatt«r  uom  unvalued  the  events  at  the 
previous  five  steps/pitches. 


To  optiaize  ccntrcl  at  »ae  rxita  stwp/pitch  we  will  be.  using 
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for  aula  (16.13)  and  bearing  .d  jaa*u  cast  function  u7‘(S'*')  with  any  ic 
already  is  in  Table  16.1.  ae*  a  w«  uaa  ;a  ccipare  net  twe,  but  three 
nuabars,  wh ich  correspond  tc  tar««  concrois;  however,  since  cne  of 
then  corresponding  tc  centre*  if3'—  always  zero,  then  write  cut  we 
will  ue  only  twe  of  thea.  it  cau  ruabacs  prove  to  be  positive,  let 
us  select  the  contrcl  wticn  corresponds  greater  of  thea;  if  cne  of 
the  ntabecs  will  be  positive,  nuutaec  -  negative,  let  us  select  the 
control  which  corresponds  to  po&*«-iVd  ausoer;  if  both  will  be 
negative,  let  us  select  ccnuox  ^  Baca  let  us  reduce  in  Table  16.2. 

The  optiaizaticn  cf  tn«  fitvu  scep/prtch  is  carried  out.  The 
output:  after  the  fourth  ster/t*twa  anuer  no  conditions  it  is  not 
necessary  to  send  exclccatxc~ . 
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fable  16*2. 


I  » 

0 

t 

* 

2 

3 

4 

6 

\..\{\~P)*  p-s  +  &Usikyl)) 

0,88 

0,30 

0,02 

<0 

<  0 

_ 

.1  (1  —  p)*  p  —  (S  4-  /-)  -f- 

+  tl -  />)**' 

0,68 

0,26 

<  0 

<  0 

<  0 

— 

U\  (?") 

(/<» 

£/‘" 

(/'" 

Ui3) 

t/<3> 

U'3) 

0,88 

0,30 

0.02 

0 

0 

0 
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If  the  information  atout  tne  taxg«t  is  obtained  recently  or  for  one 
cr  two  shots  thus  far,  then  -t  necessary  tc  do  the  fifth  shot 
(control  (/")•  but  if  frci  tne  aoa«»Mt/torgue  cf  obtaining  the 
latter/last  information  about.  taw  target  are  dene  three  or  mere  than 
shots,  it  is  necessary  to  c«as«  s^cociag. 

-et  us  compose  analogous  tame  for  tae  optimization  of  control 
at  the  fourth  step/pitch  (ta*le  1o.3). 

optimization  of  the  foiutu  snap/ pitch  it  is  carried  out.  The 
output:  if  after  the  third  sie^/p-tca  system  is  in  state  S*0’  (are 
recently  obtained  the  infcraatiou  about  tae  target),  then  at  the 
fourtn  step/pitch  is  ecualiy  pxox*taoia  any  of  the  controls  Ua'  — 
to  do  a  shot  and  to  send  or  *ot  to  send  exploration.  If  the 
Information  about  the  target  is  uutaiaed  for  one  shot  or  for  two  to 


DOC  =  30151509 


E  AGE  3*4 


that,  opt  in  uni  control  kill  U{1)  —  ao  x  shot  and  sand  exploration.  If 
the  information  about  the  ta.  ,i>  nocainad  for  three  shots,  optimum 
controls  t/3’ —  to  cease  shoot  i*s. 

rha  optimization  c:  tne  tattu  and  second  stap/pitch  is  carried 
cut  in  fables  16.4  and  16. n. 

During  the  optimization  or  me  first  step/ pitch  there  is  no 
necessity  to  vary  the  resort*  cr  previous.  The  state  of  the  system 
befor  a  the  first  step/pitcn  «. xr*t*  ,?0’.  Therefore  in  the  appropriate 
tabla  there  mill  be  cnly  cna  ccxuwn,  euich  corresponds  S'0>  (see  Table 
16.  6)  . 


The  process  of  the  o  per*  matron  of  control  is  completed.  Is 
found  the  optimum  control;  u*co«.a*tr9 nai  -  on  the  first  step/pitch 
and  conditional  on  all  other*: 


U  — ^  '•  WO.  (/,(&).  U>(S3).  Us(S0.  C/6(5o)- 
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fable  16.3. 


t 

* 

0 

1 

2 

3 

■■U\-p)*p-s+WX6(Sf+") 

0.90 

0,30 

0,02 

<0 

A(\— p)k  p-(s-\-r)  + 

+  <1 -/>)*  +  ' i?s*.6(S|0>) 

0,90 

0,34 

0,07 

<  0 

- 

(/.‘(S'*') 

U"\  yOl 

U'7) 

Li'7' 

y(3l 

u'3' 

0,90 

0,34 

0,07 

0 

0 
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The  corresponding  averac a/uca n  ^..e  i*=1.08;  in  other  words.  the 
■axiaja  a  verag-s/nean  inccae  win.cn  we  can  attain,  rationally  combining 
shooting  with  the  explcrataou .  ^gua!  to  1.C8. 
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fable  16.  4. 


t 

1 

* 

0 

1 

2 

1 

6  i 

1 

!  -hi 

-/»*/>- (s,*+“) 

0,94 

0,35 

0,02 

i 

1 

1  -m 

i 

i 

—  P)*P  —  (*-r')  + 

-d -/,)»►' u?;i5>s(s<°’) 

0,92 

0,16 

0,08 

— 

(/"' 

U'1' 

,/,2) 

U'M 

! 

0,94 

0.46 

0,08 

0 

Table  16.5. 


k 

d 

I 

6 

.9(1  -^V-s^^,4..,,s(S'*  +  ") 

1,06 

0,36 

— 

.1  (i  —  ;»*  />—(«  +  /•)  + 

-0-?)*"  1,  3,  6  (•S'01) 

0,95 

0,48 

1 

(/"> 

tr7) 

ui3) 

1.06 

0.4fi 

0  ( 

Table  16.6. 


* 

0 

.4(1 -/»*/>- i-f-lK,  4_  \6(sit¥") 

1  1.08 

•l<:  -  p)"  p-u  —  r)  _<l  -  r)*  +  '  W]  x  (  -  s(S’m)  i 

1.05 

i  U'u 

it'  =  It',  j  j  4  5  * 

1.08 
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Let  us  look  hew  occurs  i«oliZition  of  optious  control. 


At  the  first  step/piton  m  always  apply  control  (/".  i.e.  we  aake 


DOC  =  30151509 


PiC-E  3.9  9 


shot  and  we  do  not  send  expio cduuu .  As  a  result  o£  this  the  system 
passes  into  state  51".  In  tnia  stats,  as  can  be  seen  froi  Table  16.5, 
optimum  control  is  U'2)  —  to  ao  a  anot  and  tc  send  exploration.  If 
exploraticn  communicates  “target  .t  is  affected",  then  shooting 
ceases,  i.e.,  at  all  sclsagu«»nt  atsps/pitches  is  appliac  control  U'M. 
But  if  exploraticn  ccnnrunica.es  "targe;  it  is  net  affected",  then 
system  passes  into  state  S*0'-  In  tuis  scate,  as  can  be  seen  from  Table 
16.4,  at  the  third  step/pitca  snoaxd  oa  to  apply  control  if"  (done  a 
shot  and  not  sent  the  exploraticn^,  as  a  result  of  which  the  system 
will  pass  into  state  S'". 

ieing  converted  tc  Tana*.  1o.  o,  wa  nnd  cptimua  control  cn 
fourta  step/pitch  U<2)  (tc  sauce  ana  to  send  exploraticn).  If  will  be 
reported  "target  it  is  affected",  shooting  ceases  at  the  following 
step/pitch.  If  will  fce  reported  "target  it  is  net  affected",  then 
system  passes  into  state  S'0'-,  from  Taole  16.2  we  find  optimum  control 
cn  fifth  step/pitch  U'"  (to  .afoot  ani  uot  to  send  exploration).  As  a 
rasulc  of  this  ccntrcl  the  system  will  pass  ictc  state  5"’.  Frcm  Table 
16.1  it  is  evident  tbat  in  tais  case  tae  optixus  control  at  the  sixth 
step/pitch  again  exists  l/1’- 

Fig.  16.3  depicts  the  trajectory  of  point  S  in  the  phase  space 
during  the  obtained  optimum  centres,  constructed  on  the  assusption 

that  the  first  exploration  coamun^cated  "target  it  was  not  affected", 

but  the  second  -  "target  was  affected". 
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Fig.  16.3. 

Page  174. 

In  our  example  it  turn***  out  chit  in  the  optimum  control  0*  are 
iacluijd  only  controls  (7(1)  a*. a  £/*.  aad  control  t/3'  appears  only  in 
the  case  Proceedings  "target  it  ia  affected".  This  hill  not  always  be 
thus.  In  ether  parameters  or  cn.  proolam  control  Ui3)  can  prove  to  be 
advantageous  and  wither t  auuia^s  Proceedings  the  "target  is 
affected".  We  recommend  tc  r»au««.  as  tae  exercise  tc  find  the 
solution  cf  problem  with  tne  fonowiag  parameters: 

m  =  5;  p  =  y''  3=1;  s  =  y ;  r  =  y . 

Let  us  jive  for  the  collatiou  tae  optimum  ccntrcl  which  must  be 
obtained  during  the  solution  or  cais  task 

u'  =  (u( U{1\  C/1'.  (f3).  ut3)). 

This  stochastic  tasx  ptov«s  to  d a  in  a  certain  sense 
"degenerate, "  since  optimum  centrox  is  not  by  chance. 
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